![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4687 originally caused by: Started by upstream project "master-osmo-trx" build number 4896 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12996 originally caused by: Started by upstream project "master-openbsc" build number 13195 originally caused by: Started by user Oliver Smith Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17689 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7515 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6695 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8719 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2998 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29318 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5157 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30105 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4687 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12996 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9261 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4714 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5196 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3913 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins15438852261483609272.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 11:25:34 + trial_dir_prefix=trial- + rm -rf trial-2403 trial-2403-bin.tgz trial-2403-run.tgz + trial_dir=trial-2404 + mkdir -p trial-2404 + mv open5gs.build-8.tgz osmo-bsc.build-17689.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6695.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2998.tgz osmo-mgw.build-8965.tgz osmo-msc.build-29318.tgz osmo-nitb.build-12996.tgz osmo-pcu-oc2g.build-3913.tgz osmo-pcu-sysmo.build-5196.tgz osmo-pcu.build-5157.tgz osmo-sgsn.build-30105.tgz osmo-stp.build-9261.tgz osmo-trx.build-4687.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz trial-2404 + cat open5gs.build-8.md5 osmo-bsc.build-17689.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6695.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2998.md5 osmo-mgw.build-8965.md5 osmo-msc.build-29318.md5 osmo-nitb.build-12996.md5 osmo-pcu-oc2g.build-3913.md5 osmo-pcu-sysmo.build-5196.md5 osmo-pcu.build-5157.md5 osmo-sgsn.build-30105.md5 osmo-stp.build-9261.md5 osmo-trx.build-4687.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17689.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6695.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2998.md5 osmo-mgw.build-8965.md5 osmo-msc.build-29318.md5 osmo-nitb.build-12996.md5 osmo-pcu-oc2g.build-3913.md5 osmo-pcu-sysmo.build-5196.md5 osmo-pcu.build-5157.md5 osmo-sgsn.build-30105.md5 osmo-stp.build-9261.md5 osmo-trx.build-4687.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2404 combinations: None trial: 'trial-2404' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2404 -------------------------------------------------------------------------------------------- 11:25:45.243514 tst trial-2404: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/log --------------------------------------------------------------------- trial-2404 nitb_sms:sysmo --------------------------------------------------------------------- 11:27:53.478743 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:53.483395 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 11:27:53.505406 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 11:27:53.512690 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 11:27:53.567288 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 11:27:53.588784 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 11:27:53.595945 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 11:27:54.135543 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 11:27:54.140910 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 11:27:54.152244 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 11:27:54.540408 tst mo_mt_sms.py: using LAC 40579 11:27:54.785205 tst mo_mt_sms.py: using RAC 34 11:27:54.907039 tst mo_mt_sms.py: using CellId 40579 11:27:55.029395 tst mo_mt_sms.py: using BVCI 40580 11:27:55.145571 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 11:27:55.329263 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 11:27:55.444996 tst mo_mt_sms.py:9: start nitb and bts... 11:27:55.645379 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:27:57.877213 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16272): Launched 11:27:58.179463 run osmo-nitb_10.42.42.2(pid=16273): Launched 11:27:58.342788 run osmo-nitb_10.42.42.2(pid=16273): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16273)] 11:27:58.466407 run osmo-nitb_10.42.42.2(pid=16273): stdout: | (launched: 2022-12-14_11:27:58.122279) 11:27:58.591342 run osmo-nitb_10.42.42.2(pid=16273): stderr: | (launched: 2022-12-14_11:27:58.166805) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:27:58.716506 run osmo-nitb_10.42.42.2(pid=16273): stdout: | (launched: 2022-12-14_11:27:58.122279) 11:27:58.835740 run osmo-nitb_10.42.42.2(pid=16273): stderr: | (launched: 2022-12-14_11:27:58.166805) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:27:58.979026 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=16273): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16273) [trial-2404↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16273)] [trial-2404↪nitb_sms:sysmo↪mo_mt_sms.py:11] 11:27:58.987250 tst mo_mt_sms.py:11: Test FAILED (4.8 sec) 11:27:58.993841 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16272): Terminating (SIGTERM) 11:27:59.203604 --- ParallelTerminationStrategy: PID 16272 died... 11:27:59.224588 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16272): Terminated: ok {rc=0} 11:27:59.312526 bus /sierra_3: Setting Powered False 11:28:00.414045 bus /sierra_3: Setting Powered False 11:28:01.532842 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 sms:sysmo --------------------------------------------------------------------- 11:28:02.719107 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:02.723411 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 11:28:02.744666 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 11:28:02.772115 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 11:28:02.826510 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 11:28:02.848165 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 11:28:02.875052 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 11:28:03.422083 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 sms:sysmo mo_mt_sms.py ---------------------------------------------- 11:28:03.427453 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:28:03.438892 tst sms:sysmo: Using 1 x bts (candidates: 1) 11:28:03.473955 tst mo_mt_sms.py: using LAC 40580 11:28:03.595533 tst mo_mt_sms.py: using RAC 35 11:28:03.710963 tst mo_mt_sms.py: using CellId 40580 11:28:03.826360 tst mo_mt_sms.py: using BVCI 40581 11:28:03.936286 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:28:03.946824 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:28:03.957229 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:28:03.967517 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:28:03.977956 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:28:03.989194 tst sms:sysmo: Using 1 x modem (candidates: 2) 11:28:04.108664 tst sms:sysmo: Using 1 x modem (candidates: 2) 11:28:04.227699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:05.932683 run create_hlr_db(pid=16279): Launched 11:28:06.047222 bus /sierra_2: Setting Powered False 11:28:07.107362 run create_hlr_db(pid=16279): Terminated: ok {rc=0} 11:28:07.532437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16281): Launched 11:28:07.835869 run osmo-hlr_10.42.42.2(pid=16282): Launched 11:28:07.950530 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:10.436593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16284): Launched 11:28:10.740288 run osmo-stp_10.42.42.5(pid=16285): Launched 11:28:10.855638 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:16.069359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16287): Launched 11:28:16.421229 run osmo-msc_10.42.42.6(pid=16288): Launched 11:28:16.796524 run osmo-stp_10.42.42.5(pid=16285): ERR: Terminated: ERROR {rc=1} [trial-2404↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16285)] 11:28:17.054030 run osmo-stp_10.42.42.5(pid=16285): stdout: | (launched: 2022-12-14_11:28:10.682485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:17.289192 run osmo-stp_10.42.42.5(pid=16285): stderr: | [0;m[38;5;43m20221214112810851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112810851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112810851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112810852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112810852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112810852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112810853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:17.418772 run osmo-stp_10.42.42.5(pid=16285): stdout: | (launched: 2022-12-14_11:28:10.682485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:17.540125 run osmo-stp_10.42.42.5(pid=16285): stderr: | [0;m[38;5;43m20221214112810851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112810851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112810851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112810852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112810852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112810852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112810853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:17.683865 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=16285): Process ended prematurely: osmo-stp_10.42.42.5(pid=16285) [trial-2404↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16285)] [trial-2404↪sms:sysmo↪mo_mt_sms.py:16] 11:28:17.692676 tst mo_mt_sms.py:16: Test FAILED (14.3 sec) 11:28:17.719174 run osmo-hlr_10.42.42.2(pid=16282): ERR: Terminated: ERROR {rc=237} [trial-2404↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16282)] 11:28:17.768486 run osmo-hlr_10.42.42.2(pid=16282): stdout: | (launched: 2022-12-14_11:28:07.778309) 11:28:17.819336 run osmo-hlr_10.42.42.2(pid=16282): stderr: | [0;m[1;31m20221214112807954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112807954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112807954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112807954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112807954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112807954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112807966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112807974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112807974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112807974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:17.890009 run osmo-msc_10.42.42.6(pid=16288): ERR: Terminated: ERROR {rc=2} [trial-2404↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16288)] 11:28:17.938889 run osmo-msc_10.42.42.6(pid=16288): stdout: | (launched: 2022-12-14_11:28:16.359510) 11:28:17.989744 run osmo-msc_10.42.42.6(pid=16288): stderr: | [0;m[38;5;43m20221214112816897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112816897 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f64e66e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112816897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112816897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112816897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112816897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112816899 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112816899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112816900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112816900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:18.040902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16281): Terminating (SIGTERM) 11:28:18.082164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16284): Terminating (SIGTERM) 11:28:18.123127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16287): Terminating (SIGTERM) 11:28:18.164208 --- ParallelTerminationStrategy: PID 16281 died... 11:28:18.184175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16281): Terminated: ok {rc=0} 11:28:18.229847 --- ParallelTerminationStrategy: PID 16284 died... 11:28:18.249299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16284): Terminated: ok {rc=0} 11:28:18.294366 --- ParallelTerminationStrategy: PID 16287 died... 11:28:18.313712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16287): Terminated: ok {rc=0} 11:28:18.402023 bus /sierra_3: Setting Powered False 11:28:19.504683 bus /sierra_3: Setting Powered False 11:28:20.624865 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_ussd:sysmo --------------------------------------------------------------------- 11:28:21.845646 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:21.850237 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 11:28:21.871627 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 11:28:21.878612 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 11:28:21.915160 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 11:28:21.936415 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 11:28:21.943373 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 11:28:22.461986 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 11:28:22.468424 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 11:28:22.479800 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 11:28:22.515372 tst assert_extension.py: using LAC 40581 11:28:22.643529 tst assert_extension.py: using RAC 36 11:28:22.770714 tst assert_extension.py: using CellId 40581 11:28:22.899659 tst assert_extension.py: using BVCI 40582 11:28:23.018977 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 11:28:23.135952 tst assert_extension.py:10: start nitb and bts... 11:28:23.356186 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:28:24.019706 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16293): Launched 11:28:24.345055 run osmo-nitb_10.42.42.2(pid=16294): Launched 11:28:24.525676 run osmo-nitb_10.42.42.2(pid=16294): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16294)] 11:28:24.670593 run osmo-nitb_10.42.42.2(pid=16294): stdout: | (launched: 2022-12-14_11:28:24.284213) 11:28:24.817436 run osmo-nitb_10.42.42.2(pid=16294): stderr: | (launched: 2022-12-14_11:28:24.332297) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:28:24.981231 run osmo-nitb_10.42.42.2(pid=16294): stdout: | (launched: 2022-12-14_11:28:24.284213) 11:28:25.151870 run osmo-nitb_10.42.42.2(pid=16294): stderr: | (launched: 2022-12-14_11:28:24.332297) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16294): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16294) [trial-2404↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16294)] 11:28:25.467806 tst osmo-nitb_10.42.42.2(pid=16294): stdout: | (launched: 2022-12-14_11:28:24.284213) 11:28:25.599005 tst osmo-nitb_10.42.42.2(pid=16294): stderr: | (launched: 2022-12-14_11:28:24.332297) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:28:25.752689 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=16294): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16294) [trial-2404↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16294)] [trial-2404↪nitb_ussd:sysmo↪assert_extension.py:12] 11:28:25.761791 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:28:25.768898 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16293): Terminating (SIGTERM) 11:28:25.979681 --- ParallelTerminationStrategy: PID 16293 died... 11:28:26.001289 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16293): Terminated: ok {rc=0} 11:28:26.090353 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 ussd:sysmo --------------------------------------------------------------------- 11:28:27.343337 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:27.347456 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 11:28:27.368785 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 11:28:27.396308 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 11:28:27.430925 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 11:28:27.452427 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 11:28:27.479464 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 11:28:28.009996 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 ussd:sysmo assert_extension.py ---------------------------------------------- 11:28:28.015448 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:28:28.026631 tst ussd:sysmo: Using 1 x bts (candidates: 1) 11:28:28.060905 tst assert_extension.py: using LAC 40582 11:28:28.178643 tst assert_extension.py: using RAC 37 11:28:28.296678 tst assert_extension.py: using CellId 40582 11:28:28.412687 tst assert_extension.py: using BVCI 40583 11:28:28.521560 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:28:28.532248 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:28:28.542835 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:28:28.553387 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:28:28.564242 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:28:28.575034 tst ussd:sysmo: Using 1 x modem (candidates: 1) 11:28:28.694029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:29.198139 run create_hlr_db(pid=16301): Launched 11:28:29.331582 bus /sierra_2: Setting Powered False 11:28:30.395132 run create_hlr_db(pid=16301): Terminated: ok {rc=0} 11:28:30.830431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16303): Launched 11:28:31.154999 run osmo-hlr_10.42.42.2(pid=16304): Launched 11:28:31.467199 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:32.073320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16306): Launched 11:28:32.445109 run osmo-stp_10.42.42.5(pid=16307): Launched 11:28:32.589334 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:33.145489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16309): Launched 11:28:33.450649 run osmo-msc_10.42.42.6(pid=16310): Launched 11:28:33.620820 run osmo-stp_10.42.42.5(pid=16307): ERR: Terminated: ERROR {rc=1} [trial-2404↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16307)] 11:28:33.747737 run osmo-stp_10.42.42.5(pid=16307): stdout: | (launched: 2022-12-14_11:28:32.386150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:33.874784 run osmo-stp_10.42.42.5(pid=16307): stderr: | [0;m[38;5;43m20221214112832555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112832556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112832556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112832556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112832557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112832557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112832557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:34.000768 run osmo-stp_10.42.42.5(pid=16307): stdout: | (launched: 2022-12-14_11:28:32.386150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:34.121432 run osmo-stp_10.42.42.5(pid=16307): stderr: | [0;m[38;5;43m20221214112832555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112832556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112832556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112832556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112832557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112832557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112832557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:34.265132 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=16307): Process ended prematurely: osmo-stp_10.42.42.5(pid=16307) [trial-2404↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16307)] [trial-2404↪ussd:sysmo↪assert_extension.py:17] 11:28:34.273514 tst assert_extension.py:17: Test FAILED (6.3 sec) 11:28:34.299653 run osmo-hlr_10.42.42.2(pid=16304): ERR: Terminated: ERROR {rc=237} [trial-2404↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16304)] 11:28:34.348608 run osmo-hlr_10.42.42.2(pid=16304): stdout: | (launched: 2022-12-14_11:28:31.095943) 11:28:34.398818 run osmo-hlr_10.42.42.2(pid=16304): stderr: | [0;m[1;31m20221214112831339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112831339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112831339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112831339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112831339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112831339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112831360 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112831368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112831368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112831368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:34.469243 run osmo-msc_10.42.42.6(pid=16310): ERR: Terminated: ERROR {rc=2} [trial-2404↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16310)] 11:28:34.517648 run osmo-msc_10.42.42.6(pid=16310): stdout: | (launched: 2022-12-14_11:28:33.392807) 11:28:34.568168 run osmo-msc_10.42.42.6(pid=16310): stderr: | [0;m[38;5;43m20221214112833664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112833665 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faee3b0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112833665 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112833665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112833665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112833665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112833667 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112833667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112833667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112833668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:34.619016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16303): Terminating (SIGTERM) 11:28:34.659842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16306): Terminating (SIGTERM) 11:28:34.700586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16309): Terminating (SIGTERM) 11:28:34.741508 --- ParallelTerminationStrategy: PID 16303 died... 11:28:34.760863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16303): Terminated: ok {rc=0} 11:28:34.805698 --- ParallelTerminationStrategy: PID 16306 died... 11:28:34.824789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16306): Terminated: ok {rc=0} 11:28:34.869488 --- ParallelTerminationStrategy: PID 16309 died... 11:28:34.888493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16309): Terminated: ok {rc=0} 11:28:34.975758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:28:36.186346 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:36.192667 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:28:36.213344 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:28:36.240616 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:28:36.292364 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:28:36.313273 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:28:36.340232 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:28:36.890628 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:28:36.942940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:36.954242 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:28:37.011207 tst mo_mt_call.py: using LAC 40583 11:28:37.134895 tst mo_mt_call.py: using RAC 38 11:28:37.260934 tst mo_mt_call.py: using CellId 40583 11:28:37.381588 tst mo_mt_call.py: using BVCI 40584 11:28:37.504820 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.516682 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.528359 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.539956 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.551741 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.563607 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:28:37.681409 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:28:37.802553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:38.316054 run create_hlr_db(pid=16315): Launched 11:28:38.451897 bus /sierra_2: Setting Powered False 11:28:39.513744 run create_hlr_db(pid=16315): Terminated: ok {rc=0} 11:28:39.975580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16317): Launched 11:28:40.307568 run osmo-hlr_10.42.42.2(pid=16318): Launched 11:28:40.434475 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:41.004284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16320): Launched 11:28:41.336635 run osmo-stp_10.42.42.5(pid=16321): Launched 11:28:41.463612 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:42.061842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16323): Launched 11:28:42.394487 run osmo-msc_10.42.42.6(pid=16324): Launched 11:28:42.577191 run osmo-stp_10.42.42.5(pid=16321): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16321)] 11:28:42.720260 run osmo-stp_10.42.42.5(pid=16321): stdout: | (launched: 2022-12-14_11:28:41.275118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:42.858796 run osmo-stp_10.42.42.5(pid=16321): stderr: | [0;m[38;5;43m20221214112841465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112841465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112841466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112841466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112841467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112841467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112841467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:42.995971 run osmo-stp_10.42.42.5(pid=16321): stdout: | (launched: 2022-12-14_11:28:41.275118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:43.126904 run osmo-stp_10.42.42.5(pid=16321): stderr: | [0;m[38;5;43m20221214112841465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112841465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112841466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112841466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112841467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112841467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112841467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:43.283131 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16321): Process ended prematurely: osmo-stp_10.42.42.5(pid=16321) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16321)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:28:43.292723 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:28:43.320659 run osmo-hlr_10.42.42.2(pid=16318): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16318)] 11:28:43.371542 run osmo-hlr_10.42.42.2(pid=16318): stdout: | (launched: 2022-12-14_11:28:40.245800) 11:28:43.424164 run osmo-hlr_10.42.42.2(pid=16318): stderr: | [0;m[1;31m20221214112840444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112840444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112840444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112840444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112840444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112840444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112840485 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112840496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112840496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112840496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:43.497588 run osmo-msc_10.42.42.6(pid=16324): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16324)] 11:28:43.548261 run osmo-msc_10.42.42.6(pid=16324): stdout: | (launched: 2022-12-14_11:28:42.332351) 11:28:43.600387 run osmo-msc_10.42.42.6(pid=16324): stderr: | [0;m[38;5;43m20221214112842653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112842654 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f31f2d22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112842654 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112842654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112842654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112842654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112842656 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112842656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112842656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112842656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:43.653382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16317): Terminating (SIGTERM) 11:28:43.696138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16320): Terminating (SIGTERM) 11:28:43.738620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16323): Terminating (SIGTERM) 11:28:43.781099 --- ParallelTerminationStrategy: PID 16317 died... 11:28:43.801140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16317): Terminated: ok {rc=0} 11:28:43.847531 --- ParallelTerminationStrategy: PID 16320 died... 11:28:43.867360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16320): Terminated: ok {rc=0} 11:28:43.914064 --- ParallelTerminationStrategy: PID 16323 died... 11:28:43.933818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16323): Terminated: ok {rc=0} 11:28:44.022959 bus /sierra_3: Setting Powered False 11:28:45.123198 bus /sierra_3: Setting Powered False 11:28:46.250502 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:28:47.415084 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:47.426924 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:28:47.483854 tst mo_mt_call_osmux.py: using LAC 40584 11:28:47.615556 tst mo_mt_call_osmux.py: using RAC 39 11:28:47.738935 tst mo_mt_call_osmux.py: using CellId 40584 11:28:47.859730 tst mo_mt_call_osmux.py: using BVCI 40585 11:28:47.972758 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:47.983944 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:47.994876 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:48.005936 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:48.017102 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:48.028351 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:28:48.150313 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:28:48.268515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:48.748665 run create_hlr_db(pid=16326): Launched 11:28:48.868089 bus /sierra_2: Setting Powered False 11:28:49.928670 run create_hlr_db(pid=16326): Terminated: ok {rc=0} 11:28:50.382618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16328): Launched 11:28:50.717153 run osmo-hlr_10.42.42.2(pid=16329): Launched 11:28:50.844201 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:51.416353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16331): Launched 11:28:51.750183 run osmo-stp_10.42.42.5(pid=16332): Launched 11:28:51.876571 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:52.474009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16334): Launched 11:28:52.804805 run osmo-msc_10.42.42.6(pid=16335): Launched 11:28:52.988069 run osmo-stp_10.42.42.5(pid=16332): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16332)] 11:28:53.127060 run osmo-stp_10.42.42.5(pid=16332): stdout: | (launched: 2022-12-14_11:28:51.687677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:53.266846 run osmo-stp_10.42.42.5(pid=16332): stderr: | [0;m[38;5;43m20221214112851881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112851881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112851882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112851882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112851883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112851883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112851883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:53.404291 run osmo-stp_10.42.42.5(pid=16332): stdout: | (launched: 2022-12-14_11:28:51.687677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:53.535632 run osmo-stp_10.42.42.5(pid=16332): stderr: | [0;m[38;5;43m20221214112851881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112851881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112851882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112851882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112851883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112851883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112851883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:53.692470 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16332): Process ended prematurely: osmo-stp_10.42.42.5(pid=16332) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16332)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:28:53.702170 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:28:53.730362 run osmo-hlr_10.42.42.2(pid=16329): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16329)] 11:28:53.781137 run osmo-hlr_10.42.42.2(pid=16329): stdout: | (launched: 2022-12-14_11:28:50.655068) 11:28:53.833378 run osmo-hlr_10.42.42.2(pid=16329): stderr: | [0;m[1;31m20221214112850854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112850854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112850854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112850854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112850854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112850854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112850870 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112850878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112850878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112850878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:53.905812 run osmo-msc_10.42.42.6(pid=16335): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16335)] 11:28:53.956143 run osmo-msc_10.42.42.6(pid=16335): stdout: | (launched: 2022-12-14_11:28:52.742929) 11:28:54.008127 run osmo-msc_10.42.42.6(pid=16335): stderr: | [0;m[38;5;43m20221214112853062 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112853062 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b2aa46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112853062 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112853063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112853063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112853063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112853065 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112853065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112853065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112853065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:54.060413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16328): Terminating (SIGTERM) 11:28:54.102377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16331): Terminating (SIGTERM) 11:28:54.144327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16334): Terminating (SIGTERM) 11:28:54.186519 --- ParallelTerminationStrategy: PID 16328 died... 11:28:54.206742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16328): Terminated: ok {rc=0} 11:28:54.253092 --- ParallelTerminationStrategy: PID 16331 died... 11:28:54.272700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16331): Terminated: ok {rc=0} 11:28:54.318773 --- ParallelTerminationStrategy: PID 16334 died... 11:28:54.338345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16334): Terminated: ok {rc=0} 11:28:54.426910 bus /sierra_3: Setting Powered False 11:28:55.524264 bus /sierra_3: Setting Powered False 11:28:56.640212 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:28:57.880025 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:57.887874 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:28:57.909464 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:28:57.936816 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:28:57.989770 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:28:58.011209 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:28:58.039171 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:28:58.589397 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:28:58.640210 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:58.651389 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:28:58.707670 tst mo_mt_call.py: using LAC 40585 11:28:58.829992 tst mo_mt_call.py: using RAC 40 11:28:58.952108 tst mo_mt_call.py: using CellId 40585 11:28:59.074020 tst mo_mt_call.py: using BVCI 40586 11:28:59.187488 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:59.198575 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:59.209407 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:59.220129 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:59.231314 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:59.242605 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:28:59.363916 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:28:59.482504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:59.997955 run create_hlr_db(pid=16340): Launched 11:29:00.133612 bus /sierra_2: Setting Powered False 11:29:01.216405 run create_hlr_db(pid=16340): Terminated: ok {rc=0} 11:29:01.664621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16342): Launched 11:29:02.004168 run osmo-hlr_10.42.42.2(pid=16343): Launched 11:29:02.151012 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:02.763702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16345): Launched 11:29:03.096523 run osmo-stp_10.42.42.5(pid=16346): Launched 11:29:03.222971 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:03.823118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16348): Launched 11:29:04.155345 run osmo-msc_10.42.42.6(pid=16349): Launched 11:29:04.340366 run osmo-stp_10.42.42.5(pid=16346): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16346)] 11:29:04.480220 run osmo-stp_10.42.42.5(pid=16346): stdout: | (launched: 2022-12-14_11:29:03.034776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:04.620385 run osmo-stp_10.42.42.5(pid=16346): stderr: | [0;m[38;5;43m20221214112903229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112903229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112903229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112903230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112903230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112903230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112903230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:04.758075 run osmo-stp_10.42.42.5(pid=16346): stdout: | (launched: 2022-12-14_11:29:03.034776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:04.889383 run osmo-stp_10.42.42.5(pid=16346): stderr: | [0;m[38;5;43m20221214112903229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112903229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112903229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112903230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112903230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112903230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112903230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:05.046078 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16346): Process ended prematurely: osmo-stp_10.42.42.5(pid=16346) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16346)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:29:05.055653 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:29:05.083317 run osmo-hlr_10.42.42.2(pid=16343): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16343)] 11:29:05.133797 run osmo-hlr_10.42.42.2(pid=16343): stdout: | (launched: 2022-12-14_11:29:01.944549) 11:29:05.185728 run osmo-hlr_10.42.42.2(pid=16343): stderr: | [0;m[1;31m20221214112902262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112902262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112902262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112902262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112902262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112902262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112902274 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112902282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112902283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112902283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:05.257940 run osmo-msc_10.42.42.6(pid=16349): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16349)] 11:29:05.308092 run osmo-msc_10.42.42.6(pid=16349): stdout: | (launched: 2022-12-14_11:29:04.093236) 11:29:05.359991 run osmo-msc_10.42.42.6(pid=16349): stderr: | [0;m[38;5;43m20221214112904413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112904413 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c4c481c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112904413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112904413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112904414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112904414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112904415 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112904416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112904416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112904416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:05.411936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16342): Terminating (SIGTERM) 11:29:05.453813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16345): Terminating (SIGTERM) 11:29:05.496571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16348): Terminating (SIGTERM) 11:29:05.539042 --- ParallelTerminationStrategy: PID 16342 died... 11:29:05.559053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16342): Terminated: ok {rc=0} 11:29:05.605503 --- ParallelTerminationStrategy: PID 16345 died... 11:29:05.624888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16345): Terminated: ok {rc=0} 11:29:05.671204 --- ParallelTerminationStrategy: PID 16348 died... 11:29:05.690930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16348): Terminated: ok {rc=0} 11:29:05.778949 bus /sierra_3: Setting Powered False 11:29:06.879146 bus /sierra_3: Setting Powered False 11:29:07.997114 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:29:09.147597 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.159837 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:29:09.217443 tst mo_mt_call_osmux.py: using LAC 40586 11:29:09.348277 tst mo_mt_call_osmux.py: using RAC 41 11:29:09.469875 tst mo_mt_call_osmux.py: using CellId 40586 11:29:09.592117 tst mo_mt_call_osmux.py: using BVCI 40587 11:29:09.705053 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.716180 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.727086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.738073 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.749209 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.760286 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:29:09.877669 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:29:10.001258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:10.498758 run create_hlr_db(pid=16351): Launched 11:29:10.616874 bus /sierra_2: Setting Powered False 11:29:11.677928 run create_hlr_db(pid=16351): Terminated: ok {rc=0} 11:29:12.132912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16353): Launched 11:29:12.466745 run osmo-hlr_10.42.42.2(pid=16354): Launched 11:29:12.593868 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:13.165020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16356): Launched 11:29:13.499082 run osmo-stp_10.42.42.5(pid=16357): Launched 11:29:13.626267 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:14.225850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16359): Launched 11:29:14.559694 run osmo-msc_10.42.42.6(pid=16360): Launched 11:29:14.744803 run osmo-stp_10.42.42.5(pid=16357): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16357)] 11:29:14.883535 run osmo-stp_10.42.42.5(pid=16357): stdout: | (launched: 2022-12-14_11:29:13.435876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:15.023776 run osmo-stp_10.42.42.5(pid=16357): stderr: | [0;m[38;5;43m20221214112913628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112913628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112913628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112913629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112913629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112913629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112913629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:15.161689 run osmo-stp_10.42.42.5(pid=16357): stdout: | (launched: 2022-12-14_11:29:13.435876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:15.293041 run osmo-stp_10.42.42.5(pid=16357): stderr: | [0;m[38;5;43m20221214112913628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112913628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112913628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112913629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112913629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112913629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112913629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:15.449917 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16357): Process ended prematurely: osmo-stp_10.42.42.5(pid=16357) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16357)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:29:15.459616 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:29:15.487842 run osmo-hlr_10.42.42.2(pid=16354): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16354)] 11:29:15.538506 run osmo-hlr_10.42.42.2(pid=16354): stdout: | (launched: 2022-12-14_11:29:12.404817) 11:29:15.590489 run osmo-hlr_10.42.42.2(pid=16354): stderr: | [0;m[1;31m20221214112912603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112912603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112912603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112912603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112912603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112912603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112912615 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112912624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112912624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112912624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:15.663025 run osmo-msc_10.42.42.6(pid=16360): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16360)] 11:29:15.713332 run osmo-msc_10.42.42.6(pid=16360): stdout: | (launched: 2022-12-14_11:29:14.497758) 11:29:15.765257 run osmo-msc_10.42.42.6(pid=16360): stderr: | [0;m[38;5;43m20221214112914818 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112914818 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8781a9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112914818 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112914818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112914818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112914819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112914820 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112914821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112914821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112914821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:15.817611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16353): Terminating (SIGTERM) 11:29:15.878589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16356): Terminating (SIGTERM) 11:29:15.937060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16359): Terminating (SIGTERM) 11:29:15.979934 --- ParallelTerminationStrategy: PID 16353 died... 11:29:16.000610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16353): Terminated: ok {rc=0} 11:29:16.049059 --- ParallelTerminationStrategy: PID 16356 died... 11:29:16.069545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16356): Terminated: ok {rc=0} 11:29:16.116875 --- ParallelTerminationStrategy: PID 16359 died... 11:29:16.137560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16359): Terminated: ok {rc=0} 11:29:16.233135 bus /sierra_3: Setting Powered False 11:29:17.344395 bus /sierra_3: Setting Powered False 11:29:18.460431 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:29:19.692772 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:29:19.700934 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:29:19.722469 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:29:19.749907 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:29:19.803613 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:29:19.825139 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:29:19.852199 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:29:20.403066 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:29:20.455503 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:20.467052 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:29:20.524103 tst mo_mt_call.py: using LAC 40587 11:29:20.655233 tst mo_mt_call.py: using RAC 42 11:29:20.789047 tst mo_mt_call.py: using CellId 40587 11:29:20.918254 tst mo_mt_call.py: using BVCI 40588 11:29:21.038111 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:21.049756 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:21.061105 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:21.072385 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:21.083728 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:21.095202 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:29:21.213701 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:29:21.336615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:21.852877 run create_hlr_db(pid=16365): Launched 11:29:21.987017 bus /sierra_2: Setting Powered False 11:29:23.051927 run create_hlr_db(pid=16365): Terminated: ok {rc=0} 11:29:23.494268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16367): Launched 11:29:23.805694 run osmo-hlr_10.42.42.2(pid=16368): Launched 11:29:23.925197 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:24.470278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16370): Launched 11:29:24.779768 run osmo-stp_10.42.42.5(pid=16371): Launched 11:29:24.899235 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:25.459586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16373): Launched 11:29:25.771560 run osmo-msc_10.42.42.6(pid=16374): Launched 11:29:25.946557 run osmo-stp_10.42.42.5(pid=16371): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16371)] 11:29:26.078080 run osmo-stp_10.42.42.5(pid=16371): stdout: | (launched: 2022-12-14_11:29:24.721282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:26.209196 run osmo-stp_10.42.42.5(pid=16371): stderr: | [0;m[38;5;43m20221214112924888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112924889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112924889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112924889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112924891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112924891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112924891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:26.337964 run osmo-stp_10.42.42.5(pid=16371): stdout: | (launched: 2022-12-14_11:29:24.721282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:26.460850 run osmo-stp_10.42.42.5(pid=16371): stderr: | [0;m[38;5;43m20221214112924888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112924889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112924889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112924889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112924891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112924891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112924891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:26.608063 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16371): Process ended prematurely: osmo-stp_10.42.42.5(pid=16371) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16371)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:29:26.617306 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:29:26.643959 run osmo-hlr_10.42.42.2(pid=16368): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16368)] 11:29:26.693473 run osmo-hlr_10.42.42.2(pid=16368): stdout: | (launched: 2022-12-14_11:29:23.747137) 11:29:26.744225 run osmo-hlr_10.42.42.2(pid=16368): stderr: | [0;m[1;31m20221214112923925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112923925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112923926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112923926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112923926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112923926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112923938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112923949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112923949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112923949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:26.814329 run osmo-msc_10.42.42.6(pid=16374): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16374)] 11:29:26.862730 run osmo-msc_10.42.42.6(pid=16374): stdout: | (launched: 2022-12-14_11:29:25.713257) 11:29:26.912651 run osmo-msc_10.42.42.6(pid=16374): stderr: | [0;m[38;5;43m20221214112925983 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112925983 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0756a10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112925984 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112925984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112925984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112925984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112925986 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112925986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112925986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112925986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:26.963259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16367): Terminating (SIGTERM) 11:29:27.003838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16370): Terminating (SIGTERM) 11:29:27.044231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16373): Terminating (SIGTERM) 11:29:27.085208 --- ParallelTerminationStrategy: PID 16367 died... 11:29:27.104865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16367): Terminated: ok {rc=0} 11:29:27.149647 --- ParallelTerminationStrategy: PID 16370 died... 11:29:27.168916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16370): Terminated: ok {rc=0} 11:29:27.213466 --- ParallelTerminationStrategy: PID 16373 died... 11:29:27.232844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16373): Terminated: ok {rc=0} 11:29:27.319632 bus /sierra_3: Setting Powered False 11:29:28.419924 bus /sierra_3: Setting Powered False 11:29:29.537368 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:29:30.688234 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:30.700618 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:29:30.758792 tst mo_mt_call_osmux.py: using LAC 40588 11:29:30.899784 tst mo_mt_call_osmux.py: using RAC 43 11:29:31.070270 tst mo_mt_call_osmux.py: using CellId 40588 11:29:31.229789 tst mo_mt_call_osmux.py: using BVCI 40589 11:29:31.394844 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.409847 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.423669 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.440045 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.456315 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.472492 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:29:31.605266 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:29:31.759116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:32.272285 run create_hlr_db(pid=16376): Launched 11:29:32.435734 bus /sierra_2: Setting Powered False 11:29:33.500760 run create_hlr_db(pid=16376): Terminated: ok {rc=0} 11:29:33.961583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16378): Launched 11:29:34.294141 run osmo-hlr_10.42.42.2(pid=16379): Launched 11:29:34.420384 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:34.990196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16381): Launched 11:29:35.323762 run osmo-stp_10.42.42.5(pid=16382): Launched 11:29:35.450696 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:36.049543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16384): Launched 11:29:36.384643 run osmo-msc_10.42.42.6(pid=16385): Launched 11:29:36.570638 run osmo-stp_10.42.42.5(pid=16382): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16382)] 11:29:36.709076 run osmo-stp_10.42.42.5(pid=16382): stdout: | (launched: 2022-12-14_11:29:35.261714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:36.849811 run osmo-stp_10.42.42.5(pid=16382): stderr: | [0;m[38;5;43m20221214112935453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112935453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112935453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112935454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112935454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112935454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112935454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:36.987542 run osmo-stp_10.42.42.5(pid=16382): stdout: | (launched: 2022-12-14_11:29:35.261714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:37.119227 run osmo-stp_10.42.42.5(pid=16382): stderr: | [0;m[38;5;43m20221214112935453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112935453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112935453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112935454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112935454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112935454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112935454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:37.276432 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16382): Process ended prematurely: osmo-stp_10.42.42.5(pid=16382) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16382)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:29:37.286449 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:29:37.314536 run osmo-hlr_10.42.42.2(pid=16379): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16379)] 11:29:37.365060 run osmo-hlr_10.42.42.2(pid=16379): stdout: | (launched: 2022-12-14_11:29:34.231852) 11:29:37.417449 run osmo-hlr_10.42.42.2(pid=16379): stderr: | [0;m[1;31m20221214112934431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112934431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112934431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112934431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112934431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112934431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112934453 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112934463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112934463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112934463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:37.490492 run osmo-msc_10.42.42.6(pid=16385): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16385)] 11:29:37.541473 run osmo-msc_10.42.42.6(pid=16385): stdout: | (launched: 2022-12-14_11:29:36.322558) 11:29:37.593879 run osmo-msc_10.42.42.6(pid=16385): stderr: | [0;m[38;5;43m20221214112936643 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112936643 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbdff555c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112936643 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112936643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112936644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112936644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112936646 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112936646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112936646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112936646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:37.646449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16378): Terminating (SIGTERM) 11:29:37.688909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16381): Terminating (SIGTERM) 11:29:37.731886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16384): Terminating (SIGTERM) 11:29:37.775515 --- ParallelTerminationStrategy: PID 16378 died... 11:29:37.795769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16378): Terminated: ok {rc=0} 11:29:37.842145 --- ParallelTerminationStrategy: PID 16381 died... 11:29:37.861935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16381): Terminated: ok {rc=0} 11:29:37.908424 --- ParallelTerminationStrategy: PID 16384 died... 11:29:37.928199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16384): Terminated: ok {rc=0} 11:29:38.016687 bus /sierra_3: Setting Powered False 11:29:39.118603 bus /sierra_3: Setting Powered False 11:29:40.237079 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:29:41.480897 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:29:41.487840 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:29:41.509121 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:29:41.536356 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:29:41.588570 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:29:41.609800 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:29:41.637410 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:29:42.190586 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:29:42.243700 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:42.255117 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:29:42.313746 tst mo_mt_call.py: using LAC 40589 11:29:42.446181 tst mo_mt_call.py: using RAC 44 11:29:42.577072 tst mo_mt_call.py: using CellId 40589 11:29:42.702108 tst mo_mt_call.py: using BVCI 40590 11:29:42.823820 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:42.835337 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:42.846754 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:42.858008 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:42.869773 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:42.881628 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:29:43.000012 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:29:43.118108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:43.633655 run create_hlr_db(pid=16392): Launched 11:29:43.768106 bus /sierra_2: Setting Powered False 11:29:44.832052 run create_hlr_db(pid=16392): Terminated: ok {rc=0} 11:29:45.291690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16394): Launched 11:29:45.622522 run osmo-hlr_10.42.42.2(pid=16395): Launched 11:29:45.747766 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:46.411489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16397): Launched 11:29:46.747465 run osmo-stp_10.42.42.5(pid=16398): Launched 11:29:46.991347 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:47.666076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16400): Launched 11:29:47.977429 run osmo-msc_10.42.42.6(pid=16401): Launched 11:29:48.148918 run osmo-stp_10.42.42.5(pid=16398): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16398)] 11:29:48.279155 run osmo-stp_10.42.42.5(pid=16398): stdout: | (launched: 2022-12-14_11:29:46.684555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:48.409314 run osmo-stp_10.42.42.5(pid=16398): stderr: | [0;m[38;5;43m20221214112947017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112947017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112947017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112947018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112947018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112947018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112947018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:48.538361 run osmo-stp_10.42.42.5(pid=16398): stdout: | (launched: 2022-12-14_11:29:46.684555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:48.660630 run osmo-stp_10.42.42.5(pid=16398): stderr: | [0;m[38;5;43m20221214112947017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112947017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112947017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112947018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112947018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112947018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112947018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:48.807416 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16398): Process ended prematurely: osmo-stp_10.42.42.5(pid=16398) [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16398)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:29:48.816608 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 11:29:48.843023 run osmo-hlr_10.42.42.2(pid=16395): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16395)] 11:29:48.891524 run osmo-hlr_10.42.42.2(pid=16395): stdout: | (launched: 2022-12-14_11:29:45.560678) 11:29:48.941273 run osmo-hlr_10.42.42.2(pid=16395): stderr: | [0;m[1;31m20221214112945761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112945761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112945761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112945761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112945761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112945761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112945777 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112945787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112945787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112945787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:49.010758 run osmo-msc_10.42.42.6(pid=16401): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16401)] 11:29:49.058266 run osmo-msc_10.42.42.6(pid=16401): stdout: | (launched: 2022-12-14_11:29:47.919249) 11:29:49.107934 run osmo-msc_10.42.42.6(pid=16401): stderr: | [0;m[38;5;43m20221214112948189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112948189 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd1df393c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112948189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112948189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112948189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112948190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112948191 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112948192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112948192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112948192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:49.157997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16394): Terminating (SIGTERM) 11:29:49.198166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16397): Terminating (SIGTERM) 11:29:49.238416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16400): Terminating (SIGTERM) 11:29:49.278875 --- ParallelTerminationStrategy: PID 16394 died... 11:29:49.298456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16394): Terminated: ok {rc=0} 11:29:49.342911 --- ParallelTerminationStrategy: PID 16397 died... 11:29:49.362059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16397): Terminated: ok {rc=0} 11:29:49.406690 --- ParallelTerminationStrategy: PID 16400 died... 11:29:49.426052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16400): Terminated: ok {rc=0} 11:29:49.514336 bus /sierra_3: Setting Powered False 11:29:50.614638 bus /sierra_3: Setting Powered False 11:29:51.729848 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:29:52.876598 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:52.888431 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:29:52.945454 tst mo_mt_call_osmux.py: using LAC 40590 11:29:53.068375 tst mo_mt_call_osmux.py: using RAC 45 11:29:53.195312 tst mo_mt_call_osmux.py: using CellId 40590 11:29:53.316672 tst mo_mt_call_osmux.py: using BVCI 40591 11:29:53.430492 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.441571 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.452390 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.463183 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.474452 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.485923 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:29:53.608358 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:29:53.727788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:54.210021 run create_hlr_db(pid=16403): Launched 11:29:54.330104 bus /sierra_2: Setting Powered False 11:29:55.391532 run create_hlr_db(pid=16403): Terminated: ok {rc=0} 11:29:55.846001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16405): Launched 11:29:56.180279 run osmo-hlr_10.42.42.2(pid=16406): Launched 11:29:56.309993 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:56.883551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16408): Launched 11:29:57.217927 run osmo-stp_10.42.42.5(pid=16409): Launched 11:29:57.344073 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:57.946313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16411): Launched 11:29:58.280760 run osmo-msc_10.42.42.6(pid=16412): Launched 11:29:58.464211 run osmo-stp_10.42.42.5(pid=16409): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16409)] 11:29:58.603960 run osmo-stp_10.42.42.5(pid=16409): stdout: | (launched: 2022-12-14_11:29:57.155674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:58.743785 run osmo-stp_10.42.42.5(pid=16409): stderr: | [0;m[38;5;43m20221214112957349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112957349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112957349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112957350 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112957350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112957350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112957350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:58.882328 run osmo-stp_10.42.42.5(pid=16409): stdout: | (launched: 2022-12-14_11:29:57.155674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:59.013714 run osmo-stp_10.42.42.5(pid=16409): stderr: | [0;m[38;5;43m20221214112957349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214112957349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214112957349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214112957350 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214112957350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214112957350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214112957350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:59.171502 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16409): Process ended prematurely: osmo-stp_10.42.42.5(pid=16409) [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16409)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:29:59.181267 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:29:59.209213 run osmo-hlr_10.42.42.2(pid=16406): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16406)] 11:29:59.260075 run osmo-hlr_10.42.42.2(pid=16406): stdout: | (launched: 2022-12-14_11:29:56.118175) 11:29:59.312707 run osmo-hlr_10.42.42.2(pid=16406): stderr: | [0;m[1;31m20221214112956317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214112956317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214112956317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214112956317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214112956317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214112956317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214112956330 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214112956338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214112956339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214112956339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:59.385813 run osmo-msc_10.42.42.6(pid=16412): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16412)] 11:29:59.436585 run osmo-msc_10.42.42.6(pid=16412): stdout: | (launched: 2022-12-14_11:29:58.218507) 11:29:59.489583 run osmo-msc_10.42.42.6(pid=16412): stderr: | [0;m[38;5;43m20221214112958540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214112958540 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb50c09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214112958540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214112958540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214112958541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214112958541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214112958542 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214112958543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214112958543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214112958543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:59.542580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16405): Terminating (SIGTERM) 11:29:59.584879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16408): Terminating (SIGTERM) 11:29:59.627762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16411): Terminating (SIGTERM) 11:29:59.670299 --- ParallelTerminationStrategy: PID 16405 died... 11:29:59.690562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16405): Terminated: ok {rc=0} 11:29:59.737191 --- ParallelTerminationStrategy: PID 16408 died... 11:29:59.756808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16408): Terminated: ok {rc=0} 11:29:59.803153 --- ParallelTerminationStrategy: PID 16411 died... 11:29:59.822912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16411): Terminated: ok {rc=0} 11:29:59.911634 bus /sierra_3: Setting Powered False 11:30:01.009548 bus /sierra_3: Setting Powered False 11:30:02.133911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:30:03.371111 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:30:03.377575 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:30:03.398191 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:30:03.426280 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:30:03.476234 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:30:03.496892 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:30:03.523505 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:30:04.077318 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:30:04.127846 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:04.139034 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:30:04.194476 tst mo_mt_call.py: using LAC 40591 11:30:04.316556 tst mo_mt_call.py: using RAC 46 11:30:04.437176 tst mo_mt_call.py: using CellId 40591 11:30:04.560411 tst mo_mt_call.py: using BVCI 40592 11:30:04.682394 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:04.694155 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:04.708149 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:04.719297 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:04.733376 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:04.745475 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:30:04.864216 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:30:04.983033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:05.462066 run create_hlr_db(pid=16420): Launched 11:30:05.582458 bus /sierra_2: Setting Powered False 11:30:06.643634 run create_hlr_db(pid=16420): Terminated: ok {rc=0} 11:30:07.097797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16422): Launched 11:30:07.430488 run osmo-hlr_10.42.42.2(pid=16423): Launched 11:30:07.558861 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:08.130588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16425): Launched 11:30:08.463739 run osmo-stp_10.42.42.5(pid=16426): Launched 11:30:08.590975 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:09.191814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16428): Launched 11:30:09.524589 run osmo-msc_10.42.42.6(pid=16429): Launched 11:30:09.709847 run osmo-stp_10.42.42.5(pid=16426): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16426)] 11:30:09.851023 run osmo-stp_10.42.42.5(pid=16426): stdout: | (launched: 2022-12-14_11:30:08.401781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:09.990771 run osmo-stp_10.42.42.5(pid=16426): stderr: | [0;m[38;5;43m20221214113008594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113008594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113008594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113008595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113008595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113008596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113008596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:10.129030 run osmo-stp_10.42.42.5(pid=16426): stdout: | (launched: 2022-12-14_11:30:08.401781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:10.259680 run osmo-stp_10.42.42.5(pid=16426): stderr: | [0;m[38;5;43m20221214113008594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113008594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113008594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113008595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113008595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113008596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113008596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:10.417589 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16426): Process ended prematurely: osmo-stp_10.42.42.5(pid=16426) [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16426)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:30:10.427265 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:30:10.454997 run osmo-hlr_10.42.42.2(pid=16423): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16423)] 11:30:10.505318 run osmo-hlr_10.42.42.2(pid=16423): stdout: | (launched: 2022-12-14_11:30:07.368728) 11:30:10.557252 run osmo-hlr_10.42.42.2(pid=16423): stderr: | [0;m[1;31m20221214113007568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113007568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113007568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113007568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113007568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113007568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113007580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113007589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113007589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113007589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:10.628875 run osmo-msc_10.42.42.6(pid=16429): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16429)] 11:30:10.678718 run osmo-msc_10.42.42.6(pid=16429): stdout: | (launched: 2022-12-14_11:30:09.462092) 11:30:10.730155 run osmo-msc_10.42.42.6(pid=16429): stderr: | [0;m[38;5;43m20221214113009782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113009783 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f70f5b2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113009783 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113009783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113009783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113009783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113009785 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113009785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113009785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113009786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:10.781961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16422): Terminating (SIGTERM) 11:30:10.823903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16425): Terminating (SIGTERM) 11:30:10.865925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16428): Terminating (SIGTERM) 11:30:10.908084 --- ParallelTerminationStrategy: PID 16422 died... 11:30:10.928253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16422): Terminated: ok {rc=0} 11:30:10.974613 --- ParallelTerminationStrategy: PID 16425 died... 11:30:10.994522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16425): Terminated: ok {rc=0} 11:30:11.041049 --- ParallelTerminationStrategy: PID 16428 died... 11:30:11.060822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16428): Terminated: ok {rc=0} 11:30:11.149056 bus /sierra_3: Setting Powered False 11:30:12.249119 bus /sierra_3: Setting Powered False 11:30:13.366391 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:30:14.516493 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:14.528933 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:30:14.593469 tst mo_mt_call_osmux.py: using LAC 40592 11:30:14.723116 tst mo_mt_call_osmux.py: using RAC 47 11:30:14.851193 tst mo_mt_call_osmux.py: using CellId 40592 11:30:14.979083 tst mo_mt_call_osmux.py: using BVCI 40593 11:30:15.098878 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.110591 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.122003 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.133367 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.144892 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.156529 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:30:15.275944 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:30:15.401201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:15.928122 run create_hlr_db(pid=16431): Launched 11:30:16.100773 bus /sierra_2: Setting Powered False 11:30:17.166122 run create_hlr_db(pid=16431): Terminated: ok {rc=0} 11:30:17.602003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16433): Launched 11:30:17.912642 run osmo-hlr_10.42.42.2(pid=16434): Launched 11:30:18.033450 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:18.579800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16436): Launched 11:30:18.890195 run osmo-stp_10.42.42.5(pid=16437): Launched 11:30:19.009031 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:19.569968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16439): Launched 11:30:19.883194 run osmo-msc_10.42.42.6(pid=16440): Launched 11:30:20.057118 run osmo-stp_10.42.42.5(pid=16437): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16437)] 11:30:20.195357 run osmo-stp_10.42.42.5(pid=16437): stdout: | (launched: 2022-12-14_11:30:18.832052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:20.337830 run osmo-stp_10.42.42.5(pid=16437): stderr: | [0;m[38;5;43m20221214113019003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113019003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113019003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113019004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113019004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113019004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113019004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:20.476538 run osmo-stp_10.42.42.5(pid=16437): stdout: | (launched: 2022-12-14_11:30:18.832052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:20.609484 run osmo-stp_10.42.42.5(pid=16437): stderr: | [0;m[38;5;43m20221214113019003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113019003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113019003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113019004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113019004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113019004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113019004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:20.767503 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16437): Process ended prematurely: osmo-stp_10.42.42.5(pid=16437) [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16437)] [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:30:20.777417 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:30:20.805717 run osmo-hlr_10.42.42.2(pid=16434): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16434)] 11:30:20.856765 run osmo-hlr_10.42.42.2(pid=16434): stdout: | (launched: 2022-12-14_11:30:17.854501) 11:30:20.909332 run osmo-hlr_10.42.42.2(pid=16434): stderr: | [0;m[1;31m20221214113018030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113018030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113018030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113018030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113018030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113018030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113018042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113018050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113018050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113018050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:20.982429 run osmo-msc_10.42.42.6(pid=16440): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16440)] 11:30:21.033107 run osmo-msc_10.42.42.6(pid=16440): stdout: | (launched: 2022-12-14_11:30:19.824594) 11:30:21.085938 run osmo-msc_10.42.42.6(pid=16440): stderr: | [0;m[38;5;43m20221214113020097 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113020097 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f762dbf2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113020097 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113020097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113020097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113020097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113020099 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113020099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113020099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113020100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:21.138705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16433): Terminating (SIGTERM) 11:30:21.181235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16436): Terminating (SIGTERM) 11:30:21.224123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16439): Terminating (SIGTERM) 11:30:21.266954 --- ParallelTerminationStrategy: PID 16433 died... 11:30:21.287396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16433): Terminated: ok {rc=0} 11:30:21.334366 --- ParallelTerminationStrategy: PID 16436 died... 11:30:21.354844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16436): Terminated: ok {rc=0} 11:30:21.401794 --- ParallelTerminationStrategy: PID 16439 died... 11:30:21.421900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16439): Terminated: ok {rc=0} 11:30:21.511295 bus /sierra_3: Setting Powered False 11:30:22.610430 bus /sierra_3: Setting Powered False 11:30:23.729449 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:30:24.969285 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:30:24.976786 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:30:24.998760 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:30:25.027436 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:30:25.080690 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:30:25.102291 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:30:25.129847 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:30:25.681814 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:30:25.735980 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:25.747653 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:30:25.806973 tst mo_mt_call.py: using LAC 40593 11:30:25.936639 tst mo_mt_call.py: using RAC 48 11:30:26.066386 tst mo_mt_call.py: using CellId 40593 11:30:26.196794 tst mo_mt_call.py: using BVCI 40594 11:30:26.318361 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:26.329863 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:26.341285 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:26.352539 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:26.363934 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:26.375343 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:30:26.498963 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:30:26.617418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:27.097481 run create_hlr_db(pid=16445): Launched 11:30:27.215590 bus /sierra_2: Setting Powered False 11:30:28.277820 run create_hlr_db(pid=16445): Terminated: ok {rc=0} 11:30:28.733684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16447): Launched 11:30:29.066582 run osmo-hlr_10.42.42.2(pid=16448): Launched 11:30:29.193792 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:29.765627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16450): Launched 11:30:30.100422 run osmo-stp_10.42.42.5(pid=16451): Launched 11:30:30.227746 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:30.833285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16453): Launched 11:30:31.166376 run osmo-msc_10.42.42.6(pid=16454): Launched 11:30:31.507323 run osmo-stp_10.42.42.5(pid=16451): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16451)] 11:30:31.861611 run osmo-stp_10.42.42.5(pid=16451): stdout: | (launched: 2022-12-14_11:30:30.037943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:32.065655 run osmo-stp_10.42.42.5(pid=16451): stderr: | [0;m[38;5;43m20221214113030230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113030230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113030230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113030231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113030231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113030231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113030231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:32.200140 run osmo-stp_10.42.42.5(pid=16451): stdout: | (launched: 2022-12-14_11:30:30.037943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:32.328641 run osmo-stp_10.42.42.5(pid=16451): stderr: | [0;m[38;5;43m20221214113030230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113030230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113030230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113030231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113030231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113030231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113030231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:32.481617 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16451): Process ended prematurely: osmo-stp_10.42.42.5(pid=16451) [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16451)] [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:30:32.491819 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 11:30:32.519389 run osmo-hlr_10.42.42.2(pid=16448): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16448)] 11:30:32.569490 run osmo-hlr_10.42.42.2(pid=16448): stdout: | (launched: 2022-12-14_11:30:29.004425) 11:30:32.620183 run osmo-hlr_10.42.42.2(pid=16448): stderr: | [0;m[1;31m20221214113029205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113029205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113029205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113029205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113029205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113029205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113029217 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113029226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113029226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113029226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:32.691583 run osmo-msc_10.42.42.6(pid=16454): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16454)] 11:30:32.739717 run osmo-msc_10.42.42.6(pid=16454): stdout: | (launched: 2022-12-14_11:30:31.105260) 11:30:32.790466 run osmo-msc_10.42.42.6(pid=16454): stderr: | [0;m[38;5;43m20221214113031638 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113031638 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe4eb24ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113031638 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113031639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113031639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113031639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113031641 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113031641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113031641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113031641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:32.841701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16447): Terminating (SIGTERM) 11:30:32.882970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16450): Terminating (SIGTERM) 11:30:32.924771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16453): Terminating (SIGTERM) 11:30:32.966350 --- ParallelTerminationStrategy: PID 16447 died... 11:30:32.986649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16447): Terminated: ok {rc=0} 11:30:33.031932 --- ParallelTerminationStrategy: PID 16450 died... 11:30:33.051963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16450): Terminated: ok {rc=0} 11:30:33.097320 --- ParallelTerminationStrategy: PID 16453 died... 11:30:33.117117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16453): Terminated: ok {rc=0} 11:30:33.206072 bus /sierra_3: Setting Powered False 11:30:34.305895 bus /sierra_3: Setting Powered False 11:30:35.418797 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:30:36.570006 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:36.582488 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:30:36.646445 tst mo_mt_call_osmux.py: using LAC 40594 11:30:36.775135 tst mo_mt_call_osmux.py: using RAC 49 11:30:36.902578 tst mo_mt_call_osmux.py: using CellId 40594 11:30:37.030197 tst mo_mt_call_osmux.py: using BVCI 40595 11:30:37.150174 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.161824 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.173275 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.184605 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.196076 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.207590 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:30:37.326453 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:30:37.447296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:37.962695 run create_hlr_db(pid=16456): Launched 11:30:38.098102 bus /sierra_2: Setting Powered False 11:30:39.164101 run create_hlr_db(pid=16456): Terminated: ok {rc=0} 11:30:39.626482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16458): Launched 11:30:39.958563 run osmo-hlr_10.42.42.2(pid=16459): Launched 11:30:40.083645 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:40.652806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16461): Launched 11:30:40.985483 run osmo-stp_10.42.42.5(pid=16462): Launched 11:30:41.110594 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:41.708759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16464): Launched 11:30:42.042294 run osmo-msc_10.42.42.6(pid=16465): Launched 11:30:42.225506 run osmo-stp_10.42.42.5(pid=16462): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16462)] 11:30:42.363940 run osmo-stp_10.42.42.5(pid=16462): stdout: | (launched: 2022-12-14_11:30:40.923602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:42.503551 run osmo-stp_10.42.42.5(pid=16462): stderr: | [0;m[38;5;43m20221214113041117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113041117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113041117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113041118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113041118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113041118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113041118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:42.643046 run osmo-stp_10.42.42.5(pid=16462): stdout: | (launched: 2022-12-14_11:30:40.923602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:42.774188 run osmo-stp_10.42.42.5(pid=16462): stderr: | [0;m[38;5;43m20221214113041117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113041117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113041117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113041118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113041118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113041118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113041118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:42.931440 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16462): Process ended prematurely: osmo-stp_10.42.42.5(pid=16462) [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16462)] [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:30:42.941306 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:30:42.969198 run osmo-hlr_10.42.42.2(pid=16459): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16459)] 11:30:43.019524 run osmo-hlr_10.42.42.2(pid=16459): stdout: | (launched: 2022-12-14_11:30:39.896355) 11:30:43.071362 run osmo-hlr_10.42.42.2(pid=16459): stderr: | [0;m[1;31m20221214113040096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113040096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113040096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113040096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113040096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113040096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113040124 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113040133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113040133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113040134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:43.143743 run osmo-msc_10.42.42.6(pid=16465): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16465)] 11:30:43.193410 run osmo-msc_10.42.42.6(pid=16465): stdout: | (launched: 2022-12-14_11:30:41.980291) 11:30:43.244792 run osmo-msc_10.42.42.6(pid=16465): stderr: | [0;m[38;5;43m20221214113042302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113042302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1496254c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113042302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113042302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113042302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113042302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113042304 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113042304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113042305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113042305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:43.296605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16458): Terminating (SIGTERM) 11:30:43.338613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16461): Terminating (SIGTERM) 11:30:43.380830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16464): Terminating (SIGTERM) 11:30:43.423458 --- ParallelTerminationStrategy: PID 16458 died... 11:30:43.443511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16458): Terminated: ok {rc=0} 11:30:43.489579 --- ParallelTerminationStrategy: PID 16461 died... 11:30:43.509294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16461): Terminated: ok {rc=0} 11:30:43.555106 --- ParallelTerminationStrategy: PID 16464 died... 11:30:43.574704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16464): Terminated: ok {rc=0} 11:30:43.661973 bus /sierra_3: Setting Powered False 11:30:44.759850 bus /sierra_3: Setting Powered False 11:30:45.874695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:30:47.152276 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:30:47.158676 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:30:47.181173 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:30:47.209973 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:30:47.264840 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:30:47.287463 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:30:47.317057 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:30:47.863796 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:30:47.917891 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:47.929146 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:30:47.988474 tst mo_mt_call.py: using LAC 40595 11:30:48.110472 tst mo_mt_call.py: using RAC 50 11:30:48.231998 tst mo_mt_call.py: using CellId 40595 11:30:48.353389 tst mo_mt_call.py: using BVCI 40596 11:30:48.465186 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.476040 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.486893 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.497518 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.508489 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.519581 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:30:48.642333 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:30:48.763117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:49.279967 run create_hlr_db(pid=16471): Launched 11:30:49.415764 bus /sierra_2: Setting Powered False 11:30:50.481617 run create_hlr_db(pid=16471): Terminated: ok {rc=0} 11:30:50.924941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16473): Launched 11:30:51.237259 run osmo-hlr_10.42.42.2(pid=16474): Launched 11:30:51.354823 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:51.900610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16476): Launched 11:30:52.234114 run osmo-stp_10.42.42.5(pid=16480): Launched 11:30:52.361034 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:52.963728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16482): Launched 11:30:53.297377 run osmo-msc_10.42.42.6(pid=16483): Launched 11:30:53.482100 run osmo-stp_10.42.42.5(pid=16480): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16480)] 11:30:53.621835 run osmo-stp_10.42.42.5(pid=16480): stdout: | (launched: 2022-12-14_11:30:52.171870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:53.761434 run osmo-stp_10.42.42.5(pid=16480): stderr: | [0;m[38;5;43m20221214113052365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113052365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113052365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113052366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113052366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113052366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113052366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:53.899484 run osmo-stp_10.42.42.5(pid=16480): stdout: | (launched: 2022-12-14_11:30:52.171870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:54.031049 run osmo-stp_10.42.42.5(pid=16480): stderr: | [0;m[38;5;43m20221214113052365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113052365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113052365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113052366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113052366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113052366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113052366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:54.188286 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16480): Process ended prematurely: osmo-stp_10.42.42.5(pid=16480) [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16480)] [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:30:54.198008 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:30:54.225734 run osmo-hlr_10.42.42.2(pid=16474): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16474)] 11:30:54.275934 run osmo-hlr_10.42.42.2(pid=16474): stdout: | (launched: 2022-12-14_11:30:51.178818) 11:30:54.328572 run osmo-hlr_10.42.42.2(pid=16474): stderr: | [0;m[1;31m20221214113051356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113051356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113051356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113051356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113051356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113051356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113051368 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113051376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113051376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113051376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:54.401294 run osmo-msc_10.42.42.6(pid=16483): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16483)] 11:30:54.451596 run osmo-msc_10.42.42.6(pid=16483): stdout: | (launched: 2022-12-14_11:30:53.235199) 11:30:54.503612 run osmo-msc_10.42.42.6(pid=16483): stderr: | [0;m[38;5;43m20221214113053556 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113053556 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fabac952c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113053556 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113053556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113053557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113053557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113053559 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113053559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113053559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113053559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:54.556200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16473): Terminating (SIGTERM) 11:30:54.598521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16476): Terminating (SIGTERM) 11:30:54.641295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16482): Terminating (SIGTERM) 11:30:54.684298 --- ParallelTerminationStrategy: PID 16473 died... 11:30:54.704817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16473): Terminated: ok {rc=0} 11:30:54.751577 --- ParallelTerminationStrategy: PID 16476 died... 11:30:54.771275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16476): Terminated: ok {rc=0} 11:30:54.817613 --- ParallelTerminationStrategy: PID 16482 died... 11:30:54.837315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16482): Terminated: ok {rc=0} 11:30:54.926277 bus /sierra_3: Setting Powered False 11:30:56.028312 bus /sierra_3: Setting Powered False 11:30:57.145504 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:30:58.296307 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:58.308357 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:30:58.370928 tst mo_mt_call_osmux.py: using LAC 40596 11:30:58.499186 tst mo_mt_call_osmux.py: using RAC 51 11:30:58.627385 tst mo_mt_call_osmux.py: using CellId 40596 11:30:58.757103 tst mo_mt_call_osmux.py: using BVCI 40597 11:30:58.877209 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:58.888534 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:58.899762 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:58.910951 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:58.922161 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:58.933463 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:30:59.053530 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:30:59.176572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:59.692188 run create_hlr_db(pid=16485): Launched 11:30:59.827290 bus /sierra_2: Setting Powered False 11:31:00.909127 run create_hlr_db(pid=16485): Terminated: ok {rc=0} 11:31:01.380600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16487): Launched 11:31:01.719903 run osmo-hlr_10.42.42.2(pid=16488): Launched 11:31:02.003701 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:02.618484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16490): Launched 11:31:02.929367 run osmo-stp_10.42.42.5(pid=16491): Launched 11:31:03.047930 run osmo-msc_10.42.42.6: Starting osmo-msc 11:31:03.607047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16493): Launched 11:31:03.918789 run osmo-msc_10.42.42.6(pid=16494): Launched 11:31:04.091445 run osmo-stp_10.42.42.5(pid=16491): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16491)] 11:31:04.222645 run osmo-stp_10.42.42.5(pid=16491): stdout: | (launched: 2022-12-14_11:31:02.870878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:04.353438 run osmo-stp_10.42.42.5(pid=16491): stderr: | [0;m[38;5;43m20221214113103038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113103038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113103039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113103039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:04.481966 run osmo-stp_10.42.42.5(pid=16491): stdout: | (launched: 2022-12-14_11:31:02.870878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:04.604362 run osmo-stp_10.42.42.5(pid=16491): stderr: | [0;m[38;5;43m20221214113103038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113103038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113103039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113103039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113103040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:04.751441 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16491): Process ended prematurely: osmo-stp_10.42.42.5(pid=16491) [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16491)] [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:31:04.760463 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:31:04.786957 run osmo-hlr_10.42.42.2(pid=16488): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16488)] 11:31:04.835784 run osmo-hlr_10.42.42.2(pid=16488): stdout: | (launched: 2022-12-14_11:31:01.657126) 11:31:04.885944 run osmo-hlr_10.42.42.2(pid=16488): stderr: | [0;m[1;31m20221214113101920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113101920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113101920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113101920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113101920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113101920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113101945 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113101966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113101968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113101968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:04.956308 run osmo-msc_10.42.42.6(pid=16494): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16494)] 11:31:05.004331 run osmo-msc_10.42.42.6(pid=16494): stdout: | (launched: 2022-12-14_11:31:03.860349) 11:31:05.054580 run osmo-msc_10.42.42.6(pid=16494): stderr: | [0;m[38;5;43m20221214113104131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113104132 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50902c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113104132 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113104132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113104132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113104132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113104134 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113104134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113104134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113104135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:31:05.105222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16487): Terminating (SIGTERM) 11:31:05.146421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16490): Terminating (SIGTERM) 11:31:05.186890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16493): Terminating (SIGTERM) 11:31:05.227515 --- ParallelTerminationStrategy: PID 16487 died... 11:31:05.247092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16487): Terminated: ok {rc=0} 11:31:05.291437 --- ParallelTerminationStrategy: PID 16490 died... 11:31:05.310406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16490): Terminated: ok {rc=0} 11:31:05.354599 --- ParallelTerminationStrategy: PID 16493 died... 11:31:05.373563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16493): Terminated: ok {rc=0} 11:31:05.460329 bus /sierra_3: Setting Powered False 11:31:06.559410 bus /sierra_3: Setting Powered False 11:31:07.675409 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 emergency:sysmo --------------------------------------------------------------------- 11:31:08.906398 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:31:08.911026 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 11:31:08.931600 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 11:31:08.958877 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 11:31:09.048112 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 11:31:09.069595 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 11:31:09.096213 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 11:31:09.674061 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2404 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 11:31:09.679085 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:09.689667 tst emergency:sysmo: Using 1 x bts (candidates: 1) 11:31:09.725393 tst emergency_mo_mt_call.py: using LAC 40597 11:31:09.848387 tst emergency_mo_mt_call.py: using RAC 52 11:31:09.967872 tst emergency_mo_mt_call.py: using CellId 40597 11:31:10.085035 tst emergency_mo_mt_call.py: using BVCI 40598 11:31:10.194477 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:10.205064 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:10.215556 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:10.226446 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:10.237115 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:10.247906 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:31:10.369999 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:31:10.488161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:10.960943 run create_hlr_db(pid=16499): Launched 11:31:11.078938 bus /sierra_2: Setting Powered False 11:31:12.139870 run create_hlr_db(pid=16499): Terminated: ok {rc=0} 11:31:12.589930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16501): Launched 11:31:12.920013 run osmo-hlr_10.42.42.2(pid=16502): Launched 11:31:13.045351 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:13.607738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16504): Launched 11:31:13.934716 run osmo-stp_10.42.42.5(pid=16505): Launched 11:31:14.070112 tst emergency_mo_mt_call.py: using MSISDN 8665 11:31:14.236284 run osmo-msc_10.42.42.6: Starting osmo-msc 11:31:14.824475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16507): Launched 11:31:15.154548 run osmo-msc_10.42.42.6(pid=16508): Launched 11:31:15.336393 run osmo-stp_10.42.42.5(pid=16505): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16505)] 11:31:15.472617 run osmo-stp_10.42.42.5(pid=16505): stdout: | (launched: 2022-12-14_11:31:13.873649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:15.610082 run osmo-stp_10.42.42.5(pid=16505): stderr: | [0;m[38;5;43m20221214113114063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113114063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113114064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113114064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113114065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113114065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113114065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:15.745883 run osmo-stp_10.42.42.5(pid=16505): stdout: | (launched: 2022-12-14_11:31:13.873649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:15.893307 run osmo-stp_10.42.42.5(pid=16505): stderr: | [0;m[38;5;43m20221214113114063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113114063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113114064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113114064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113114065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113114065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113114065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:16.054131 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=16505): Process ended prematurely: osmo-stp_10.42.42.5(pid=16505) [trial-2404↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16505)] [trial-2404↪emergency:sysmo↪emergency_mo_mt_call.py:19] 11:31:16.063635 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 11:31:16.091722 run osmo-hlr_10.42.42.2(pid=16502): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16502)] 11:31:16.146668 run osmo-hlr_10.42.42.2(pid=16502): stdout: | (launched: 2022-12-14_11:31:12.858580) 11:31:16.200318 run osmo-hlr_10.42.42.2(pid=16502): stderr: | [0;m[1;31m20221214113113056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113113056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113113056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113113056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113113056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113113056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113113068 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113113077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113113077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113113077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:16.275369 run osmo-msc_10.42.42.6(pid=16508): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16508)] 11:31:16.328728 run osmo-msc_10.42.42.6(pid=16508): stdout: | (launched: 2022-12-14_11:31:15.093284) 11:31:16.381783 run osmo-msc_10.42.42.6(pid=16508): stderr: | [0;m[38;5;43m20221214113115413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113115413 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4e4507fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113115413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113115414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113115414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113115414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113115416 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113115416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113115416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113115416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:31:16.435340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16501): Terminating (SIGTERM) 11:31:16.478577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16504): Terminating (SIGTERM) 11:31:16.521822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16507): Terminating (SIGTERM) 11:31:16.565694 --- ParallelTerminationStrategy: PID 16501 died... 11:31:16.586519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16501): Terminated: ok {rc=0} 11:31:16.634435 --- ParallelTerminationStrategy: PID 16504 died... 11:31:16.654992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16504): Terminated: ok {rc=0} 11:31:16.702758 --- ParallelTerminationStrategy: PID 16507 died... 11:31:16.723317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16507): Terminated: ok {rc=0} 11:31:16.814291 bus /sierra_3: Setting Powered False 11:31:17.916762 bus /sierra_3: Setting Powered False 11:31:19.035315 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 11:31:20.123056 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:20.134858 tst emergency:sysmo: Using 1 x bts (candidates: 1) 11:31:20.172900 tst emergency_preemptive_call.py: using LAC 40598 11:31:20.301367 tst emergency_preemptive_call.py: using RAC 53 11:31:20.428712 tst emergency_preemptive_call.py: using CellId 40598 11:31:20.556364 tst emergency_preemptive_call.py: using BVCI 40599 11:31:20.675538 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:20.686820 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:20.697895 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:20.708794 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:20.719993 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:31:20.731148 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:31:20.849771 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:31:20.970922 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:31:21.090705 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:31:21.210665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:21.718127 run create_hlr_db(pid=16511): Launched 11:31:21.851478 bus /sierra_2: Setting Powered False 11:31:22.915712 run create_hlr_db(pid=16511): Terminated: ok {rc=0} 11:31:23.352759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16513): Launched 11:31:23.660320 run osmo-hlr_10.42.42.2(pid=16514): Launched 11:31:23.779260 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:24.306930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16516): Launched 11:31:24.612155 run osmo-stp_10.42.42.5(pid=16517): Launched 11:31:24.739097 tst emergency_preemptive_call.py: using MSISDN 8666 11:31:24.903608 run osmo-msc_10.42.42.6: Starting osmo-msc 11:31:25.450116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16519): Launched 11:31:25.755004 run osmo-msc_10.42.42.6(pid=16520): Launched 11:31:25.932211 run osmo-stp_10.42.42.5(pid=16517): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16517)] 11:31:26.060658 run osmo-stp_10.42.42.5(pid=16517): stdout: | (launched: 2022-12-14_11:31:24.554521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:26.189494 run osmo-stp_10.42.42.5(pid=16517): stderr: | [0;m[38;5;43m20221214113124724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113124724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113124725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113124725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113124726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113124726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113124726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:26.316204 run osmo-stp_10.42.42.5(pid=16517): stdout: | (launched: 2022-12-14_11:31:24.554521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:26.437164 run osmo-stp_10.42.42.5(pid=16517): stderr: | [0;m[38;5;43m20221214113124724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113124724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113124725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113124725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113124726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113124726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113124726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:26.582466 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=16517): Process ended prematurely: osmo-stp_10.42.42.5(pid=16517) [trial-2404↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16517)] [trial-2404↪emergency:sysmo↪emergency_preemptive_call.py:32] 11:31:26.590994 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 11:31:26.616837 run osmo-hlr_10.42.42.2(pid=16514): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16514)] 11:31:26.665698 run osmo-hlr_10.42.42.2(pid=16514): stdout: | (launched: 2022-12-14_11:31:23.602736) 11:31:26.715831 run osmo-hlr_10.42.42.2(pid=16514): stderr: | [0;m[1;31m20221214113123778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113123778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113123778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113123778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113123778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113123778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113123790 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113123798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113123799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113123799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:26.786071 run osmo-msc_10.42.42.6(pid=16520): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16520)] 11:31:26.834195 run osmo-msc_10.42.42.6(pid=16520): stdout: | (launched: 2022-12-14_11:31:25.697474) 11:31:26.884140 run osmo-msc_10.42.42.6(pid=16520): stderr: | [0;m[38;5;43m20221214113125967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113125967 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5aab663c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113125967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113125967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113125967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113125967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113125969 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113125970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113125970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113125970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:31:26.934739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16513): Terminating (SIGTERM) 11:31:26.975352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16516): Terminating (SIGTERM) 11:31:27.015654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16519): Terminating (SIGTERM) 11:31:27.056104 --- ParallelTerminationStrategy: PID 16513 died... 11:31:27.076001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16513): Terminated: ok {rc=0} 11:31:27.120704 --- ParallelTerminationStrategy: PID 16516 died... 11:31:27.139962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16516): Terminated: ok {rc=0} 11:31:27.184261 --- ParallelTerminationStrategy: PID 16519 died... 11:31:27.203513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16519): Terminated: ok {rc=0} 11:31:27.290158 bus /sierra_9: Setting Powered False 11:31:28.389151 bus /sierra_9: Setting Powered False 11:31:29.505464 bus /sierra_8: Setting Powered False 11:31:30.603844 bus /sierra_8: Setting Powered False 11:31:31.722852 bus /sierra_3: Setting Powered False 11:31:32.837138 bus /sierra_3: Setting Powered False 11:31:33.953594 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:sysmo --------------------------------------------------------------------- 11:31:35.218223 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:31:35.222813 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 11:31:35.244018 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 11:31:35.283559 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 11:31:35.374798 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 11:31:35.397042 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 11:31:35.436717 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 11:31:36.025367 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 11:31:36.080861 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:36.091831 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:31:36.128220 tst cs_paging_gprs_active.py: using LAC 40599 11:31:36.263627 tst cs_paging_gprs_active.py: using RAC 54 11:31:36.393151 tst cs_paging_gprs_active.py: using CellId 40599 11:31:36.521469 tst cs_paging_gprs_active.py: using BVCI 40600 11:31:36.642498 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:36.653555 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:36.664245 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:36.675098 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:36.685897 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:36.696684 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:36.708005 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:36.718804 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:36.729811 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:31:36.851082 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:31:36.972281 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:31:37.180695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:37.495125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16525): Launched 11:31:37.769363 run iperf3-srv_10.42.42.10(pid=16526): Launched 11:31:37.885858 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:31:38.093602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:38.406240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16527): Launched 11:31:38.677614 run iperf3-srv_10.42.42.10(pid=16528): Launched 11:31:38.793885 tst cs_paging_gprs_active.py:38: start network... 11:31:39.001239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:39.482627 run create_hlr_db(pid=16529): Launched 11:31:39.604016 bus /sierra_2: Setting Powered False 11:31:40.664868 run create_hlr_db(pid=16529): Terminated: ok {rc=0} 11:31:41.098901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16531): Launched 11:31:41.411951 run osmo-hlr_10.42.42.2(pid=16532): Launched 11:31:41.531697 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:42.076103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16534): Launched 11:31:42.388752 run osmo-stp_10.42.42.5(pid=16535): Launched 11:31:42.508308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:31:44.034921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16537): Launched 11:31:44.155234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:31:44.419606 run patchelf(pid=16538): Launched 11:31:44.595113 run osmo-stp_10.42.42.5(pid=16535): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16535)] 11:31:44.727406 run osmo-stp_10.42.42.5(pid=16535): stdout: | (launched: 2022-12-14_11:31:42.330245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:44.861474 run osmo-stp_10.42.42.5(pid=16535): stderr: | [0;m[38;5;43m20221214113142501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113142502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113142502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113142502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113142503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113142503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113142503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:44.995798 run osmo-stp_10.42.42.5(pid=16535): stdout: | (launched: 2022-12-14_11:31:42.330245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:45.124234 run osmo-stp_10.42.42.5(pid=16535): stderr: | [0;m[38;5;43m20221214113142501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113142502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113142502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113142502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113142503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113142503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113142503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:45.275283 run patchelf(pid=16538): Terminating (SIGINT) 11:31:45.449744 run patchelf(pid=16538): Terminated: ok {rc=0} 11:31:45.575589 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16535): Process ended prematurely: osmo-stp_10.42.42.5(pid=16535) [trial-2404↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16535)] [trial-2404↪gprs:sysmo↪cs_paging_gprs_active.py:38] 11:31:45.584865 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 11:31:45.612184 run osmo-hlr_10.42.42.2(pid=16532): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16532)] 11:31:45.660906 run osmo-hlr_10.42.42.2(pid=16532): stdout: | (launched: 2022-12-14_11:31:41.353702) 11:31:45.711068 run osmo-hlr_10.42.42.2(pid=16532): stderr: | [0;m[1;31m20221214113141527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113141527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113141527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113141527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113141527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113141527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113141540 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113141549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113141550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113141550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:45.761772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16525): Terminating (SIGTERM) 11:31:45.802443 run iperf3-srv_10.42.42.10(pid=16526): Terminating (SIGTERM) 11:31:45.866282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16527): Terminating (SIGTERM) 11:31:45.928013 run iperf3-srv_10.42.42.10(pid=16528): Terminating (SIGTERM) 11:31:45.970919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16531): Terminating (SIGTERM) 11:31:46.013334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16534): Terminating (SIGTERM) 11:31:46.054971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16537): Terminating (SIGTERM) 11:31:46.097015 --- ParallelTerminationStrategy: PID 16525 died... 11:31:46.117103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16525): Terminated: ok {rc=0} 11:31:46.163199 --- ParallelTerminationStrategy: PID 16526 died... 11:31:46.183209 run iperf3-srv_10.42.42.10(pid=16526): Terminated {rc=256} 11:31:46.228931 --- ParallelTerminationStrategy: PID 16527 died... 11:31:46.249582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16527): Terminated: ok {rc=0} 11:31:46.296639 --- ParallelTerminationStrategy: PID 16528 died... 11:31:46.317305 run iperf3-srv_10.42.42.10(pid=16528): Terminated {rc=256} 11:31:46.364683 --- ParallelTerminationStrategy: PID 16531 died... 11:31:46.386000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16531): Terminated: ok {rc=0} 11:31:46.433452 --- ParallelTerminationStrategy: PID 16534 died... 11:31:46.454672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16534): Terminated: ok {rc=0} 11:31:46.502206 --- ParallelTerminationStrategy: PID 16537 died... 11:31:46.523510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16537): Terminated: ok {rc=0} 11:31:46.620556 bus /gobi_0: Setting Powered False 11:31:47.731208 bus /gobi_0: Setting Powered False 11:31:48.848395 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo iperf3.py ---------------------------------------------- 11:31:49.996533 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:50.007945 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:31:50.047406 tst iperf3.py: using LAC 40600 11:31:50.169398 tst iperf3.py: using RAC 55 11:31:50.290604 tst iperf3.py: using CellId 40600 11:31:50.412315 tst iperf3.py: using BVCI 40601 11:31:50.524674 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:50.535271 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:50.545793 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:50.556669 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:50.567521 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:50.578954 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:50.589897 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:50.600659 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:50.611780 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:31:50.729696 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:31:50.939117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:51.264092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16539): Launched 11:31:51.529331 run iperf3-srv_10.42.42.10(pid=16540): Launched 11:31:51.642171 tst iperf3.py:8: start network... 11:31:51.843274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:52.311745 run create_hlr_db(pid=16541): Launched 11:31:52.425800 bus /gobi_6: Setting Powered False 11:31:53.486021 run create_hlr_db(pid=16541): Terminated: ok {rc=0} 11:31:53.928816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16543): Launched 11:31:54.231986 run osmo-hlr_10.42.42.2(pid=16544): Launched 11:31:54.347248 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:54.880906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16546): Launched 11:31:55.209072 run osmo-stp_10.42.42.5(pid=16547): Launched 11:31:55.333381 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:31:55.898611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16549): Launched 11:31:56.024375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:31:56.302624 run patchelf(pid=16550): Launched 11:31:56.485660 run osmo-stp_10.42.42.5(pid=16547): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16547)] 11:31:56.624093 run osmo-stp_10.42.42.5(pid=16547): stdout: | (launched: 2022-12-14_11:31:55.147570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:56.763773 run osmo-stp_10.42.42.5(pid=16547): stderr: | [0;m[38;5;43m20221214113155337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113155337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113155338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113155338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113155338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113155339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113155339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:56.903531 run osmo-stp_10.42.42.5(pid=16547): stdout: | (launched: 2022-12-14_11:31:55.147570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:57.036718 run osmo-stp_10.42.42.5(pid=16547): stderr: | [0;m[38;5;43m20221214113155337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113155337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113155338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113155338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113155338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113155339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113155339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:57.195471 run patchelf(pid=16550): Terminating (SIGINT) 11:31:57.378650 run patchelf(pid=16550): Terminated: ok {rc=0} 11:31:57.510622 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16547): Process ended prematurely: osmo-stp_10.42.42.5(pid=16547) [trial-2404↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16547)] [trial-2404↪gprs:sysmo↪iperf3.py:8] 11:31:57.520538 tst iperf3.py:8: Test FAILED (7.6 sec) 11:31:57.549592 run osmo-hlr_10.42.42.2(pid=16544): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16544)] 11:31:57.599377 run osmo-hlr_10.42.42.2(pid=16544): stdout: | (launched: 2022-12-14_11:31:54.175089) 11:31:57.651219 run osmo-hlr_10.42.42.2(pid=16544): stderr: | [0;m[1;31m20221214113154349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113154349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113154349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113154349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113154349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113154349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113154362 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113154370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113154370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113154370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:57.703628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16539): Terminating (SIGTERM) 11:31:57.745509 run iperf3-srv_10.42.42.10(pid=16540): Terminating (SIGTERM) 11:31:57.787317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16543): Terminating (SIGTERM) 11:31:57.829596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16546): Terminating (SIGTERM) 11:31:57.871695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16549): Terminating (SIGTERM) 11:31:57.913713 --- ParallelTerminationStrategy: PID 16539 died... 11:31:57.933679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16539): Terminated: ok {rc=0} 11:31:57.979584 --- ParallelTerminationStrategy: PID 16540 died... 11:31:57.999148 run iperf3-srv_10.42.42.10(pid=16540): Terminated {rc=256} 11:31:58.044886 --- ParallelTerminationStrategy: PID 16543 died... 11:31:58.064420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16543): Terminated: ok {rc=0} 11:31:58.110136 --- ParallelTerminationStrategy: PID 16546 died... 11:31:58.129621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16546): Terminated: ok {rc=0} 11:31:58.175400 --- ParallelTerminationStrategy: PID 16549 died... 11:31:58.194861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16549): Terminated: ok {rc=0} 11:31:58.282633 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo iperf3m4.py ---------------------------------------------- 11:31:59.434221 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:31:59.445904 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:31:59.482378 tst iperf3m4.py: using LAC 40601 11:31:59.615248 tst iperf3m4.py: using RAC 56 11:31:59.744269 tst iperf3m4.py: using CellId 40601 11:31:59.872512 tst iperf3m4.py: using BVCI 40602 11:31:59.991109 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:00.002268 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:00.013287 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:00.024023 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:00.034810 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:00.045614 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:00.056539 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:00.067404 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:00.078427 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:32:00.196698 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:32:00.315577 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:32:00.433506 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:32:00.554254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:32:00.775508 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:01.127021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16551): Launched 11:32:01.411828 run iperf3-srv_10.42.42.10(pid=16552): Launched 11:32:01.546034 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:32:01.758875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:02.079806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16553): Launched 11:32:02.367991 run iperf3-srv_10.42.42.10(pid=16554): Launched 11:32:02.484410 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:32:02.688627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:02.996364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16555): Launched 11:32:03.266338 run iperf3-srv_10.42.42.10(pid=16556): Launched 11:32:03.382300 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:32:03.585899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:03.893604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16557): Launched 11:32:04.174247 run iperf3-srv_10.42.42.10(pid=16558): Launched 11:32:04.290640 tst iperf3m4.py:8: start network... 11:32:04.493976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:04.968612 run create_hlr_db(pid=16559): Launched 11:32:05.085690 bus /gobi_6: Setting Powered False 11:32:06.146389 run create_hlr_db(pid=16559): Terminated: ok {rc=0} 11:32:06.573874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16561): Launched 11:32:06.922296 run osmo-hlr_10.42.42.2(pid=16562): Launched 11:32:07.046762 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:07.615994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16564): Launched 11:32:07.948741 run osmo-stp_10.42.42.5(pid=16565): Launched 11:32:08.075944 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:08.651964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16567): Launched 11:32:08.779210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:09.060571 run patchelf(pid=16568): Launched 11:32:09.245579 run osmo-stp_10.42.42.5(pid=16565): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16565)] 11:32:09.386242 run osmo-stp_10.42.42.5(pid=16565): stdout: | (launched: 2022-12-14_11:32:07.886366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:09.528009 run osmo-stp_10.42.42.5(pid=16565): stderr: | [0;m[38;5;43m20221214113208122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113208122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113208122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113208123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113208123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113208123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113208123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:09.669896 run osmo-stp_10.42.42.5(pid=16565): stdout: | (launched: 2022-12-14_11:32:07.886366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:09.805208 run osmo-stp_10.42.42.5(pid=16565): stderr: | [0;m[38;5;43m20221214113208122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113208122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113208122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113208123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113208123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113208123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113208123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:09.965578 run patchelf(pid=16568): Terminating (SIGINT) 11:32:10.150553 run patchelf(pid=16568): Terminated: ok {rc=0} 11:32:10.283853 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16565): Process ended prematurely: osmo-stp_10.42.42.5(pid=16565) [trial-2404↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16565)] [trial-2404↪gprs:sysmo↪iperf3m4.py:8] 11:32:10.294160 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:32:10.323070 run osmo-hlr_10.42.42.2(pid=16562): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16562)] 11:32:10.373541 run osmo-hlr_10.42.42.2(pid=16562): stdout: | (launched: 2022-12-14_11:32:06.860634) 11:32:10.425586 run osmo-hlr_10.42.42.2(pid=16562): stderr: | [0;m[1;31m20221214113207055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113207055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113207055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113207056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113207056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113207056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113207066 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113207075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113207076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113207076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:10.478049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16551): Terminating (SIGTERM) 11:32:10.519950 run iperf3-srv_10.42.42.10(pid=16552): Terminating (SIGTERM) 11:32:10.562142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16553): Terminating (SIGTERM) 11:32:10.604009 run iperf3-srv_10.42.42.10(pid=16554): Terminating (SIGTERM) 11:32:10.645909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16555): Terminating (SIGTERM) 11:32:10.688090 run iperf3-srv_10.42.42.10(pid=16556): Terminating (SIGTERM) 11:32:10.730543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16557): Terminating (SIGTERM) 11:32:10.772375 run iperf3-srv_10.42.42.10(pid=16558): Terminating (SIGTERM) 11:32:10.814635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16561): Terminating (SIGTERM) 11:32:10.857136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16564): Terminating (SIGTERM) 11:32:10.899209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16567): Terminating (SIGTERM) 11:32:10.941991 --- ParallelTerminationStrategy: PID 16551 died... 11:32:10.962007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16551): Terminated: ok {rc=0} 11:32:11.008088 --- ParallelTerminationStrategy: PID 16552 died... 11:32:11.027646 run iperf3-srv_10.42.42.10(pid=16552): Terminated {rc=256} 11:32:11.073567 --- ParallelTerminationStrategy: PID 16553 died... 11:32:11.093148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16553): Terminated: ok {rc=0} 11:32:11.139068 --- ParallelTerminationStrategy: PID 16554 died... 11:32:11.158643 run iperf3-srv_10.42.42.10(pid=16554): Terminated {rc=256} 11:32:11.204667 --- ParallelTerminationStrategy: PID 16555 died... 11:32:11.224255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16555): Terminated: ok {rc=0} 11:32:11.270226 --- ParallelTerminationStrategy: PID 16556 died... 11:32:11.290092 run iperf3-srv_10.42.42.10(pid=16556): Terminated {rc=256} 11:32:11.336119 --- ParallelTerminationStrategy: PID 16557 died... 11:32:11.355632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16557): Terminated: ok {rc=0} 11:32:11.401583 --- ParallelTerminationStrategy: PID 16558 died... 11:32:11.421077 run iperf3-srv_10.42.42.10(pid=16558): Terminated {rc=256} 11:32:11.466950 --- ParallelTerminationStrategy: PID 16561 died... 11:32:11.486519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16561): Terminated: ok {rc=0} 11:32:11.532471 --- ParallelTerminationStrategy: PID 16564 died... 11:32:11.552056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16564): Terminated: ok {rc=0} 11:32:11.598455 --- ParallelTerminationStrategy: PID 16567 died... 11:32:11.618417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16567): Terminated: ok {rc=0} 11:32:11.706747 bus /gobi_4: Setting Powered False 11:32:12.807103 bus /gobi_4: Setting Powered False 11:32:13.924557 bus /gobi_1: Setting Powered False 11:32:15.023472 bus /gobi_1: Setting Powered False 11:32:16.141160 bus /gobi_0: Setting Powered False 11:32:17.243984 bus /gobi_0: Setting Powered False 11:32:18.361936 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo ping.py ---------------------------------------------- 11:32:19.465833 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:19.477576 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:32:19.513952 tst ping.py: using LAC 40602 11:32:19.635042 tst ping.py: using RAC 57 11:32:19.756019 tst ping.py: using CellId 40602 11:32:19.874753 tst ping.py: using BVCI 40603 11:32:19.986533 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:19.997154 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:20.007728 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:20.018144 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:20.028318 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:20.039887 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:20.050746 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:20.061531 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:32:20.182789 tst ping.py:19: start network... 11:32:20.402650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:20.911126 run create_hlr_db(pid=16569): Launched 11:32:21.042582 bus /gobi_6: Setting Powered False 11:32:22.104579 run create_hlr_db(pid=16569): Terminated: ok {rc=0} 11:32:22.535214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16571): Launched 11:32:22.836210 run osmo-hlr_10.42.42.2(pid=16572): Launched 11:32:22.949964 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:23.467674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16574): Launched 11:32:23.768193 run osmo-stp_10.42.42.5(pid=16575): Launched 11:32:23.881967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:24.400487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16577): Launched 11:32:24.517937 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:24.772729 run patchelf(pid=16578): Launched 11:32:24.942480 run osmo-stp_10.42.42.5(pid=16575): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16575)] 11:32:25.071322 run osmo-stp_10.42.42.5(pid=16575): stdout: | (launched: 2022-12-14_11:32:23.712036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:25.202374 run osmo-stp_10.42.42.5(pid=16575): stderr: | [0;m[38;5;43m20221214113223881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113223882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113223882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113223882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113223883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113223883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113223883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:25.333332 run osmo-stp_10.42.42.5(pid=16575): stdout: | (launched: 2022-12-14_11:32:23.712036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:25.457820 run osmo-stp_10.42.42.5(pid=16575): stderr: | [0;m[38;5;43m20221214113223881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113223882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113223882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113223882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113223883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113223883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113223883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:25.605062 run patchelf(pid=16578): Terminating (SIGINT) 11:32:25.774782 run patchelf(pid=16578): Terminated: ok {rc=0} 11:32:25.896918 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16575): Process ended prematurely: osmo-stp_10.42.42.5(pid=16575) [trial-2404↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16575)] [trial-2404↪gprs:sysmo↪ping.py:22] 11:32:25.905864 tst ping.py:22: Test FAILED (6.4 sec) 11:32:25.932640 run osmo-hlr_10.42.42.2(pid=16572): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16572)] 11:32:25.981562 run osmo-hlr_10.42.42.2(pid=16572): stdout: | (launched: 2022-12-14_11:32:22.780215) 11:32:26.031515 run osmo-hlr_10.42.42.2(pid=16572): stderr: | [0;m[1;31m20221214113222953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113222953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113222953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113222953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113222953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113222953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113222966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113222976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113222976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113222976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:26.082205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16571): Terminating (SIGTERM) 11:32:26.123167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16574): Terminating (SIGTERM) 11:32:26.164080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16577): Terminating (SIGTERM) 11:32:26.205318 --- ParallelTerminationStrategy: PID 16571 died... 11:32:26.225164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16571): Terminated: ok {rc=0} 11:32:26.270199 --- ParallelTerminationStrategy: PID 16574 died... 11:32:26.289642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16574): Terminated: ok {rc=0} 11:32:26.334601 --- ParallelTerminationStrategy: PID 16577 died... 11:32:26.354001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16577): Terminated: ok {rc=0} 11:32:26.439875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 11:32:27.527082 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:27.539237 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:32:27.582732 tst ping_idle_ping.py: using LAC 40603 11:32:27.703017 tst ping_idle_ping.py: using RAC 58 11:32:27.820064 tst ping_idle_ping.py: using CellId 40603 11:32:27.937238 tst ping_idle_ping.py: using BVCI 40604 11:32:28.047729 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:28.058363 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:28.068792 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:28.079208 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:28.089558 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:28.101816 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:28.113297 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:32:28.124433 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:32:28.253768 tst ping_idle_ping.py:24: start network... 11:32:28.474023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:28.977566 run create_hlr_db(pid=16579): Launched 11:32:29.111168 bus /gobi_6: Setting Powered False 11:32:30.174813 run create_hlr_db(pid=16579): Terminated: ok {rc=0} 11:32:30.609024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16581): Launched 11:32:30.931579 run osmo-hlr_10.42.42.2(pid=16582): Launched 11:32:31.108455 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:31.825554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16584): Launched 11:32:32.144041 run osmo-stp_10.42.42.5(pid=16585): Launched 11:32:32.362131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:32.885768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16587): Launched 11:32:33.001196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:33.256249 run patchelf(pid=16588): Launched 11:32:33.424379 run osmo-stp_10.42.42.5(pid=16585): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16585)] 11:32:33.552901 run osmo-stp_10.42.42.5(pid=16585): stdout: | (launched: 2022-12-14_11:32:32.086844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:33.683770 run osmo-stp_10.42.42.5(pid=16585): stderr: | [0;m[38;5;43m20221214113232288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113232289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113232289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113232290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113232290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113232290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113232290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:33.813953 run osmo-stp_10.42.42.5(pid=16585): stdout: | (launched: 2022-12-14_11:32:32.086844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:33.937835 run osmo-stp_10.42.42.5(pid=16585): stderr: | [0;m[38;5;43m20221214113232288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113232289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113232289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113232290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113232290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113232290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113232290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:34.084306 run patchelf(pid=16588): Terminating (SIGINT) 11:32:34.254109 run patchelf(pid=16588): Terminated: ok {rc=0} 11:32:34.376144 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16585): Process ended prematurely: osmo-stp_10.42.42.5(pid=16585) [trial-2404↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16585)] [trial-2404↪gprs:sysmo↪ping_idle_ping.py:27] 11:32:34.384935 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 11:32:34.411556 run osmo-hlr_10.42.42.2(pid=16582): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16582)] 11:32:34.460086 run osmo-hlr_10.42.42.2(pid=16582): stdout: | (launched: 2022-12-14_11:32:30.867130) 11:32:34.509659 run osmo-hlr_10.42.42.2(pid=16582): stderr: | [0;m[1;31m20221214113231225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113231225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113231225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113231225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113231225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113231225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113231236 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113231253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113231253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113231253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:34.559601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16581): Terminating (SIGTERM) 11:32:34.600085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16584): Terminating (SIGTERM) 11:32:34.640347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16587): Terminating (SIGTERM) 11:32:34.681432 --- ParallelTerminationStrategy: PID 16581 died... 11:32:34.700741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16581): Terminated: ok {rc=0} 11:32:34.745418 --- ParallelTerminationStrategy: PID 16584 died... 11:32:34.764435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16584): Terminated: ok {rc=0} 11:32:34.809098 --- ParallelTerminationStrategy: PID 16587 died... 11:32:34.828205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16587): Terminated: ok {rc=0} 11:32:34.916327 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 11:32:36.206266 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:32:36.212440 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:32:36.234192 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:32:36.276260 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:32:36.369127 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:32:36.390331 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:32:36.430153 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:32:37.020527 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:32:37.074202 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:37.085396 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:32:37.121604 tst cs_paging_gprs_active.py: using LAC 40604 11:32:37.251341 tst cs_paging_gprs_active.py: using RAC 59 11:32:37.378696 tst cs_paging_gprs_active.py: using CellId 40604 11:32:37.505646 tst cs_paging_gprs_active.py: using BVCI 40605 11:32:37.618619 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:37.629595 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:37.640414 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:37.651248 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:37.662218 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:37.672941 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:37.683933 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:37.694689 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:37.705828 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:32:37.826762 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:32:37.946420 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:32:38.152096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:38.460658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16592): Launched 11:32:38.728552 run iperf3-srv_10.42.42.10(pid=16593): Launched 11:32:38.843891 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:32:39.048614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:39.357054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16594): Launched 11:32:39.627042 run iperf3-srv_10.42.42.10(pid=16595): Launched 11:32:39.742249 tst cs_paging_gprs_active.py:38: start network... 11:32:39.947350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:40.422814 run create_hlr_db(pid=16596): Launched 11:32:40.541486 bus /gobi_6: Setting Powered False 11:32:41.606968 run create_hlr_db(pid=16596): Terminated: ok {rc=0} 11:32:42.067299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16598): Launched 11:32:42.398685 run osmo-hlr_10.42.42.2(pid=16599): Launched 11:32:42.526426 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:43.098187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16601): Launched 11:32:43.428543 run osmo-stp_10.42.42.5(pid=16602): Launched 11:32:43.556292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:44.124917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16604): Launched 11:32:44.252602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:44.531087 run patchelf(pid=16605): Launched 11:32:44.716146 run osmo-stp_10.42.42.5(pid=16602): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16602)] 11:32:44.855586 run osmo-stp_10.42.42.5(pid=16602): stdout: | (launched: 2022-12-14_11:32:43.368052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:44.996622 run osmo-stp_10.42.42.5(pid=16602): stderr: | [0;m[38;5;43m20221214113243558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113243559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113243559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113243559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113243560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113243560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113243560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:45.137875 run osmo-stp_10.42.42.5(pid=16602): stdout: | (launched: 2022-12-14_11:32:43.368052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:45.273037 run osmo-stp_10.42.42.5(pid=16602): stderr: | [0;m[38;5;43m20221214113243558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113243559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113243559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113243559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113243560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113243560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113243560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:45.433202 run patchelf(pid=16605): Terminating (SIGINT) 11:32:45.618913 run patchelf(pid=16605): Terminated: ok {rc=0} 11:32:45.751894 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16602): Process ended prematurely: osmo-stp_10.42.42.5(pid=16602) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16602)] [trial-2404↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:32:45.762224 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:32:45.790890 run osmo-hlr_10.42.42.2(pid=16599): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16599)] 11:32:45.857194 run osmo-hlr_10.42.42.2(pid=16599): stdout: | (launched: 2022-12-14_11:32:42.338786) 11:32:45.910705 run osmo-hlr_10.42.42.2(pid=16599): stderr: | [0;m[1;31m20221214113242532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113242532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113242532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113242532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113242532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113242532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113242544 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113242553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113242554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113242554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:45.964113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16592): Terminating (SIGTERM) 11:32:46.007890 run iperf3-srv_10.42.42.10(pid=16593): Terminating (SIGTERM) 11:32:46.053886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16594): Terminating (SIGTERM) 11:32:46.098048 run iperf3-srv_10.42.42.10(pid=16595): Terminating (SIGTERM) 11:32:46.143809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16598): Terminating (SIGTERM) 11:32:46.188043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16601): Terminating (SIGTERM) 11:32:46.233297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16604): Terminating (SIGTERM) 11:32:46.278199 --- ParallelTerminationStrategy: PID 16592 died... 11:32:46.298946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16592): Terminated: ok {rc=0} 11:32:46.346350 --- ParallelTerminationStrategy: PID 16593 died... 11:32:46.366331 run iperf3-srv_10.42.42.10(pid=16593): Terminated {rc=256} 11:32:46.413593 --- ParallelTerminationStrategy: PID 16594 died... 11:32:46.433681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16594): Terminated: ok {rc=0} 11:32:46.480851 --- ParallelTerminationStrategy: PID 16595 died... 11:32:46.501235 run iperf3-srv_10.42.42.10(pid=16595): Terminated {rc=256} 11:32:46.548679 --- ParallelTerminationStrategy: PID 16598 died... 11:32:46.569317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16598): Terminated: ok {rc=0} 11:32:46.616928 --- ParallelTerminationStrategy: PID 16601 died... 11:32:46.637574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16601): Terminated: ok {rc=0} 11:32:46.684897 --- ParallelTerminationStrategy: PID 16604 died... 11:32:46.705601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16604): Terminated: ok {rc=0} 11:32:46.795954 bus /gobi_0: Setting Powered False 11:32:47.896026 bus /gobi_0: Setting Powered False 11:32:49.013903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:32:50.163823 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:50.175760 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:32:50.213008 tst iperf3.py: using LAC 40605 11:32:50.341788 tst iperf3.py: using RAC 60 11:32:50.469363 tst iperf3.py: using CellId 40605 11:32:50.598087 tst iperf3.py: using BVCI 40606 11:32:50.712179 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:50.723222 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:50.734032 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:50.744682 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:50.755781 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:50.767042 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:50.778301 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:50.789280 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:50.800736 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:32:50.924676 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:32:51.146644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:51.475583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16606): Launched 11:32:51.765654 run iperf3-srv_10.42.42.10(pid=16607): Launched 11:32:51.888337 tst iperf3.py:8: start network... 11:32:52.109340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:52.618806 run create_hlr_db(pid=16608): Launched 11:32:52.754761 bus /gobi_6: Setting Powered False 11:32:53.819219 run create_hlr_db(pid=16608): Terminated: ok {rc=0} 11:32:54.257562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16610): Launched 11:32:54.564867 run osmo-hlr_10.42.42.2(pid=16611): Launched 11:32:54.682333 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:55.208646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16613): Launched 11:32:55.515108 run osmo-stp_10.42.42.5(pid=16614): Launched 11:32:55.632792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:56.162782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16616): Launched 11:32:56.280646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:56.539905 run patchelf(pid=16617): Launched 11:32:56.710694 run osmo-stp_10.42.42.5(pid=16614): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16614)] 11:32:56.840559 run osmo-stp_10.42.42.5(pid=16614): stdout: | (launched: 2022-12-14_11:32:55.458889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:56.972245 run osmo-stp_10.42.42.5(pid=16614): stderr: | [0;m[38;5;43m20221214113255626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113255626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113255627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113255627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113255628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113255628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113255628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:57.103851 run osmo-stp_10.42.42.5(pid=16614): stdout: | (launched: 2022-12-14_11:32:55.458889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:57.229301 run osmo-stp_10.42.42.5(pid=16614): stderr: | [0;m[38;5;43m20221214113255626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113255626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113255627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113255627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113255628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113255628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113255628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:57.377777 run patchelf(pid=16617): Terminating (SIGINT) 11:32:57.549800 run patchelf(pid=16617): Terminated: ok {rc=0} 11:32:57.674471 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16614): Process ended prematurely: osmo-stp_10.42.42.5(pid=16614) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16614)] [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 11:32:57.683918 tst iperf3.py:8: Test FAILED (7.6 sec) 11:32:57.711219 run osmo-hlr_10.42.42.2(pid=16611): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16611)] 11:32:57.759987 run osmo-hlr_10.42.42.2(pid=16611): stdout: | (launched: 2022-12-14_11:32:54.508428) 11:32:57.810060 run osmo-hlr_10.42.42.2(pid=16611): stderr: | [0;m[1;31m20221214113254682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113254682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113254683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113254683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113254683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113254683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113254695 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113254704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113254705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113254705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:57.860448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16606): Terminating (SIGTERM) 11:32:57.900810 run iperf3-srv_10.42.42.10(pid=16607): Terminating (SIGTERM) 11:32:57.941145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16610): Terminating (SIGTERM) 11:32:57.981976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16613): Terminating (SIGTERM) 11:32:58.022157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16616): Terminating (SIGTERM) 11:32:58.062555 --- ParallelTerminationStrategy: PID 16606 died... 11:32:58.082216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16606): Terminated: ok {rc=0} 11:32:58.126814 --- ParallelTerminationStrategy: PID 16607 died... 11:32:58.145876 run iperf3-srv_10.42.42.10(pid=16607): Terminated {rc=256} 11:32:58.190168 --- ParallelTerminationStrategy: PID 16610 died... 11:32:58.209321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16610): Terminated: ok {rc=0} 11:32:58.253781 --- ParallelTerminationStrategy: PID 16613 died... 11:32:58.272906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16613): Terminated: ok {rc=0} 11:32:58.317399 --- ParallelTerminationStrategy: PID 16616 died... 11:32:58.336424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16616): Terminated: ok {rc=0} 11:32:58.423384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:32:59.572198 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:59.583699 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:32:59.625262 tst iperf3m4.py: using LAC 40606 11:32:59.754410 tst iperf3m4.py: using RAC 61 11:32:59.881037 tst iperf3m4.py: using CellId 40606 11:33:00.009723 tst iperf3m4.py: using BVCI 40607 11:33:00.123075 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:00.134074 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:00.144850 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:00.155634 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:00.166893 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:00.177952 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:00.188933 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:00.199763 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:00.210850 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:00.328244 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:00.452306 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:00.571768 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:00.695311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:33:00.932856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:01.273048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16618): Launched 11:33:01.602224 run iperf3-srv_10.42.42.10(pid=16620): Launched 11:33:01.734985 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:33:01.963062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:02.299100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16621): Launched 11:33:02.588025 run iperf3-srv_10.42.42.10(pid=16622): Launched 11:33:02.712594 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:33:02.933286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:03.263495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16623): Launched 11:33:03.551600 run iperf3-srv_10.42.42.10(pid=16624): Launched 11:33:03.676241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:33:03.897955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:04.227731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16625): Launched 11:33:04.513729 run iperf3-srv_10.42.42.10(pid=16626): Launched 11:33:04.638017 tst iperf3m4.py:8: start network... 11:33:04.858465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:05.366301 run create_hlr_db(pid=16627): Launched 11:33:05.498414 bus /gobi_6: Setting Powered False 11:33:06.562713 run create_hlr_db(pid=16627): Terminated: ok {rc=0} 11:33:06.999730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16629): Launched 11:33:07.306560 run osmo-hlr_10.42.42.2(pid=16630): Launched 11:33:07.423361 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:07.996143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16632): Launched 11:33:08.325633 run osmo-stp_10.42.42.5(pid=16633): Launched 11:33:08.450844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:09.016428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16635): Launched 11:33:09.147600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:09.424628 run patchelf(pid=16636): Launched 11:33:09.608471 run osmo-stp_10.42.42.5(pid=16633): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16633)] 11:33:09.747454 run osmo-stp_10.42.42.5(pid=16633): stdout: | (launched: 2022-12-14_11:33:08.265381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:09.887948 run osmo-stp_10.42.42.5(pid=16633): stderr: | [0;m[38;5;43m20221214113308455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113308455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113308456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113308456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113308456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113308457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113308457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:10.028430 run osmo-stp_10.42.42.5(pid=16633): stdout: | (launched: 2022-12-14_11:33:08.265381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:10.162675 run osmo-stp_10.42.42.5(pid=16633): stderr: | [0;m[38;5;43m20221214113308455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113308455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113308456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113308456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113308456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113308457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113308457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:10.322518 run patchelf(pid=16636): Terminating (SIGINT) 11:33:10.506115 run patchelf(pid=16636): Terminated: ok {rc=0} 11:33:10.638917 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16633): Process ended prematurely: osmo-stp_10.42.42.5(pid=16633) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16633)] [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 11:33:10.649065 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:33:10.677878 run osmo-hlr_10.42.42.2(pid=16630): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16630)] 11:33:10.728146 run osmo-hlr_10.42.42.2(pid=16630): stdout: | (launched: 2022-12-14_11:33:07.250285) 11:33:10.780247 run osmo-hlr_10.42.42.2(pid=16630): stderr: | [0;m[1;31m20221214113307424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113307424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113307424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113307424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113307424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113307424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113307435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113307443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113307443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113307443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:10.832493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16618): Terminating (SIGTERM) 11:33:10.874320 run iperf3-srv_10.42.42.10(pid=16620): Terminating (SIGTERM) 11:33:10.916129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16621): Terminating (SIGTERM) 11:33:10.958048 run iperf3-srv_10.42.42.10(pid=16622): Terminating (SIGTERM) 11:33:10.999686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16623): Terminating (SIGTERM) 11:33:11.041411 run iperf3-srv_10.42.42.10(pid=16624): Terminating (SIGTERM) 11:33:11.083219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16625): Terminating (SIGTERM) 11:33:11.125032 run iperf3-srv_10.42.42.10(pid=16626): Terminating (SIGTERM) 11:33:11.166680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16629): Terminating (SIGTERM) 11:33:11.208626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16632): Terminating (SIGTERM) 11:33:11.250421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16635): Terminating (SIGTERM) 11:33:11.292359 --- ParallelTerminationStrategy: PID 16618 died... 11:33:11.312531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16618): Terminated: ok {rc=0} 11:33:11.359112 --- ParallelTerminationStrategy: PID 16620 died... 11:33:11.378860 run iperf3-srv_10.42.42.10(pid=16620): Terminated {rc=256} 11:33:11.424807 --- ParallelTerminationStrategy: PID 16621 died... 11:33:11.445032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16621): Terminated: ok {rc=0} 11:33:11.491308 --- ParallelTerminationStrategy: PID 16622 died... 11:33:11.511062 run iperf3-srv_10.42.42.10(pid=16622): Terminated {rc=256} 11:33:11.557242 --- ParallelTerminationStrategy: PID 16623 died... 11:33:11.576839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16623): Terminated: ok {rc=0} 11:33:11.623739 --- ParallelTerminationStrategy: PID 16624 died... 11:33:11.643518 run iperf3-srv_10.42.42.10(pid=16624): Terminated {rc=256} 11:33:11.689935 --- ParallelTerminationStrategy: PID 16625 died... 11:33:11.709718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16625): Terminated: ok {rc=0} 11:33:11.756382 --- ParallelTerminationStrategy: PID 16626 died... 11:33:11.776485 run iperf3-srv_10.42.42.10(pid=16626): Terminated {rc=256} 11:33:11.822950 --- ParallelTerminationStrategy: PID 16629 died... 11:33:11.842553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16629): Terminated: ok {rc=0} 11:33:11.888502 --- ParallelTerminationStrategy: PID 16632 died... 11:33:11.908299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16632): Terminated: ok {rc=0} 11:33:11.954352 --- ParallelTerminationStrategy: PID 16635 died... 11:33:11.974037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16635): Terminated: ok {rc=0} 11:33:12.062734 bus /gobi_4: Setting Powered False 11:33:13.163980 bus /gobi_4: Setting Powered False 11:33:14.280789 bus /gobi_1: Setting Powered False 11:33:15.377894 bus /gobi_1: Setting Powered False 11:33:16.500354 bus /gobi_0: Setting Powered False 11:33:17.608891 bus /gobi_0: Setting Powered False 11:33:18.723941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 11:33:19.825494 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:19.836902 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:33:19.873872 tst ping.py: using LAC 40607 11:33:20.001729 tst ping.py: using RAC 62 11:33:20.126333 tst ping.py: using CellId 40607 11:33:20.257999 tst ping.py: using BVCI 40608 11:33:20.376445 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:20.387775 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:20.399075 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:20.410182 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:20.421704 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:20.433242 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:20.445111 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:20.456683 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:20.576227 tst ping.py:19: start network... 11:33:20.778228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:21.242699 run create_hlr_db(pid=16637): Launched 11:33:21.359727 bus /gobi_6: Setting Powered False 11:33:22.419578 run create_hlr_db(pid=16637): Terminated: ok {rc=0} 11:33:22.839805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16639): Launched 11:33:23.140329 run osmo-hlr_10.42.42.2(pid=16640): Launched 11:33:23.254707 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:23.773752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16642): Launched 11:33:24.074941 run osmo-stp_10.42.42.5(pid=16643): Launched 11:33:24.189535 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:24.705927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16645): Launched 11:33:24.820648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:25.074183 run patchelf(pid=16646): Launched 11:33:25.243429 run osmo-stp_10.42.42.5(pid=16643): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16643)] 11:33:25.371212 run osmo-stp_10.42.42.5(pid=16643): stdout: | (launched: 2022-12-14_11:33:24.019419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:25.500526 run osmo-stp_10.42.42.5(pid=16643): stderr: | [0;m[38;5;43m20221214113324187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113324187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113324188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113324188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113324189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113324189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113324189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:25.630057 run osmo-stp_10.42.42.5(pid=16643): stdout: | (launched: 2022-12-14_11:33:24.019419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:25.753212 run osmo-stp_10.42.42.5(pid=16643): stderr: | [0;m[38;5;43m20221214113324187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113324187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113324188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113324188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113324189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113324189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113324189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:25.899209 run patchelf(pid=16646): Terminating (SIGINT) 11:33:26.067242 run patchelf(pid=16646): Terminated: ok {rc=0} 11:33:26.188368 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16643): Process ended prematurely: osmo-stp_10.42.42.5(pid=16643) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16643)] [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 11:33:26.197389 tst ping.py:22: Test FAILED (6.4 sec) 11:33:26.224900 run osmo-hlr_10.42.42.2(pid=16640): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16640)] 11:33:26.273852 run osmo-hlr_10.42.42.2(pid=16640): stdout: | (launched: 2022-12-14_11:33:23.084863) 11:33:26.324236 run osmo-hlr_10.42.42.2(pid=16640): stderr: | [0;m[1;31m20221214113323255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113323255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113323255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113323255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113323255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113323255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113323266 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113323274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113323274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113323274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:26.374658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16639): Terminating (SIGTERM) 11:33:26.415604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16642): Terminating (SIGTERM) 11:33:26.456839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16645): Terminating (SIGTERM) 11:33:26.498429 --- ParallelTerminationStrategy: PID 16639 died... 11:33:26.518052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16639): Terminated: ok {rc=0} 11:33:26.563102 --- ParallelTerminationStrategy: PID 16642 died... 11:33:26.582278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16642): Terminated: ok {rc=0} 11:33:26.627095 --- ParallelTerminationStrategy: PID 16645 died... 11:33:26.646325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16645): Terminated: ok {rc=0} 11:33:26.732121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:33:27.818998 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:27.831406 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:33:27.870967 tst ping_idle_ping.py: using LAC 40608 11:33:27.999585 tst ping_idle_ping.py: using RAC 63 11:33:28.130402 tst ping_idle_ping.py: using CellId 40608 11:33:28.257235 tst ping_idle_ping.py: using BVCI 40609 11:33:28.375238 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:28.386567 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:28.397762 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:28.408829 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:28.420492 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:28.431980 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:28.443647 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:28.455276 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:28.583674 tst ping_idle_ping.py:24: start network... 11:33:28.802485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:29.302521 run create_hlr_db(pid=16647): Launched 11:33:29.434713 bus /gobi_6: Setting Powered False 11:33:30.498842 run create_hlr_db(pid=16647): Terminated: ok {rc=0} 11:33:30.958282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16649): Launched 11:33:31.281701 run osmo-hlr_10.42.42.2(pid=16650): Launched 11:33:31.522453 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:32.216134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16652): Launched 11:33:32.542833 run osmo-stp_10.42.42.5(pid=16653): Launched 11:33:32.669522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:33.231190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16655): Launched 11:33:33.355518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:33.630720 run patchelf(pid=16656): Launched 11:33:33.810821 run osmo-stp_10.42.42.5(pid=16653): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16653)] 11:33:33.948208 run osmo-stp_10.42.42.5(pid=16653): stdout: | (launched: 2022-12-14_11:33:32.482904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:34.087384 run osmo-stp_10.42.42.5(pid=16653): stderr: | [0;m[38;5;43m20221214113332672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113332672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113332672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113332672 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113332673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113332673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113332673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:34.226699 run osmo-stp_10.42.42.5(pid=16653): stdout: | (launched: 2022-12-14_11:33:32.482904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:34.359066 run osmo-stp_10.42.42.5(pid=16653): stderr: | [0;m[38;5;43m20221214113332672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113332672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113332672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113332672 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113332673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113332673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113332673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:34.516103 run patchelf(pid=16656): Terminating (SIGINT) 11:33:34.698198 run patchelf(pid=16656): Terminated: ok {rc=0} 11:33:34.828716 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16653): Process ended prematurely: osmo-stp_10.42.42.5(pid=16653) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16653)] [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 11:33:34.838506 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 11:33:34.866246 run osmo-hlr_10.42.42.2(pid=16650): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16650)] 11:33:34.916137 run osmo-hlr_10.42.42.2(pid=16650): stdout: | (launched: 2022-12-14_11:33:31.224393) 11:33:34.967613 run osmo-hlr_10.42.42.2(pid=16650): stderr: | [0;m[1;31m20221214113331560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113331560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113331560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113331560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113331560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113331560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113331574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113331591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113331591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113331591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:35.019331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16649): Terminating (SIGTERM) 11:33:35.061010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16652): Terminating (SIGTERM) 11:33:35.103055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16655): Terminating (SIGTERM) 11:33:35.145621 --- ParallelTerminationStrategy: PID 16649 died... 11:33:35.165871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16649): Terminated: ok {rc=0} 11:33:35.212445 --- ParallelTerminationStrategy: PID 16652 died... 11:33:35.232220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16652): Terminated: ok {rc=0} 11:33:35.278737 --- ParallelTerminationStrategy: PID 16655 died... 11:33:35.298461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16655): Terminated: ok {rc=0} 11:33:35.388478 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:33:36.681496 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:33:36.687817 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:33:36.709156 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:33:36.748480 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:33:36.837432 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:33:36.858751 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:33:36.898107 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:33:37.492824 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:33:37.545450 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:37.556563 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:33:37.614546 tst cs_paging_gprs_active.py: using LAC 40609 11:33:37.742677 tst cs_paging_gprs_active.py: using RAC 64 11:33:37.873259 tst cs_paging_gprs_active.py: using CellId 40609 11:33:38.003612 tst cs_paging_gprs_active.py: using BVCI 40610 11:33:38.125099 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:38.136502 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:38.147733 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:38.158893 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:38.170019 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:38.181163 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:38.192478 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:38.203589 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:38.214951 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:33:38.334636 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:33:38.452061 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:33:38.657965 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:38.965863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16662): Launched 11:33:39.254180 run iperf3-srv_10.42.42.10(pid=16663): Launched 11:33:39.379082 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:33:39.600339 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:39.930951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16664): Launched 11:33:40.218815 run iperf3-srv_10.42.42.10(pid=16665): Launched 11:33:40.343432 tst cs_paging_gprs_active.py:38: start network... 11:33:40.564021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:41.073573 run create_hlr_db(pid=16666): Launched 11:33:41.208082 bus /gobi_6: Setting Powered False 11:33:42.273437 run create_hlr_db(pid=16666): Terminated: ok {rc=0} 11:33:42.730780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16668): Launched 11:33:43.061657 run osmo-hlr_10.42.42.2(pid=16669): Launched 11:33:43.187969 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:43.757504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16671): Launched 11:33:44.088502 run osmo-stp_10.42.42.5(pid=16672): Launched 11:33:44.212451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:44.780277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16674): Launched 11:33:44.908083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:45.186459 run patchelf(pid=16675): Launched 11:33:45.370478 run osmo-stp_10.42.42.5(pid=16672): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16672)] 11:33:45.509187 run osmo-stp_10.42.42.5(pid=16672): stdout: | (launched: 2022-12-14_11:33:44.027609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:45.650716 run osmo-stp_10.42.42.5(pid=16672): stderr: | [0;m[38;5;43m20221214113344218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113344218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113344219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113344219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113344220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113344220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113344220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:45.792115 run osmo-stp_10.42.42.5(pid=16672): stdout: | (launched: 2022-12-14_11:33:44.027609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:45.950917 run osmo-stp_10.42.42.5(pid=16672): stderr: | [0;m[38;5;43m20221214113344218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113344218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113344219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113344219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113344220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113344220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113344220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:46.106374 run patchelf(pid=16675): Terminating (SIGINT) 11:33:46.285254 run patchelf(pid=16675): Terminated: ok {rc=0} 11:33:46.416610 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16672): Process ended prematurely: osmo-stp_10.42.42.5(pid=16672) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16672)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:33:46.427467 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:33:46.456122 run osmo-hlr_10.42.42.2(pid=16669): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16669)] 11:33:46.510106 run osmo-hlr_10.42.42.2(pid=16669): stdout: | (launched: 2022-12-14_11:33:43.001294) 11:33:46.561615 run osmo-hlr_10.42.42.2(pid=16669): stderr: | [0;m[1;31m20221214113343198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113343199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113343199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113343199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113343199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113343199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113343212 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113343222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113343223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113343223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:46.614844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16662): Terminating (SIGTERM) 11:33:46.658605 run iperf3-srv_10.42.42.10(pid=16663): Terminating (SIGTERM) 11:33:46.704869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16664): Terminating (SIGTERM) 11:33:46.748898 run iperf3-srv_10.42.42.10(pid=16665): Terminating (SIGTERM) 11:33:46.794624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16668): Terminating (SIGTERM) 11:33:46.837950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16671): Terminating (SIGTERM) 11:33:46.881105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16674): Terminating (SIGTERM) 11:33:46.928380 --- ParallelTerminationStrategy: PID 16662 died... 11:33:46.949666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16662): Terminated: ok {rc=0} 11:33:46.998038 --- ParallelTerminationStrategy: PID 16663 died... 11:33:47.018783 run iperf3-srv_10.42.42.10(pid=16663): Terminated {rc=256} 11:33:47.065424 --- ParallelTerminationStrategy: PID 16664 died... 11:33:47.086110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16664): Terminated: ok {rc=0} 11:33:47.133769 --- ParallelTerminationStrategy: PID 16665 died... 11:33:47.154601 run iperf3-srv_10.42.42.10(pid=16665): Terminated {rc=256} 11:33:47.200726 --- ParallelTerminationStrategy: PID 16668 died... 11:33:47.220414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16668): Terminated: ok {rc=0} 11:33:47.265128 --- ParallelTerminationStrategy: PID 16671 died... 11:33:47.284530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16671): Terminated: ok {rc=0} 11:33:47.332730 --- ParallelTerminationStrategy: PID 16674 died... 11:33:47.352589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16674): Terminated: ok {rc=0} 11:33:47.440308 bus /gobi_0: Setting Powered False 11:33:48.538784 bus /gobi_0: Setting Powered False 11:33:49.654406 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:33:50.801362 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:50.812731 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:33:50.871676 tst iperf3.py: using LAC 40610 11:33:50.991789 tst iperf3.py: using RAC 65 11:33:51.113687 tst iperf3.py: using CellId 40610 11:33:51.244386 tst iperf3.py: using BVCI 40611 11:33:51.365614 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:51.376918 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:51.388035 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:51.399215 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:51.410250 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:51.421591 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:51.432818 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:51.443911 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:51.455138 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:33:51.572649 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:33:51.779781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:52.089642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16676): Launched 11:33:52.358285 run iperf3-srv_10.42.42.10(pid=16677): Launched 11:33:52.475288 tst iperf3.py:8: start network... 11:33:52.680722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:53.154303 run create_hlr_db(pid=16678): Launched 11:33:53.273375 bus /gobi_6: Setting Powered False 11:33:54.334634 run create_hlr_db(pid=16678): Terminated: ok {rc=0} 11:33:54.762305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16680): Launched 11:33:55.070748 run osmo-hlr_10.42.42.2(pid=16681): Launched 11:33:55.187334 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:55.718368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16683): Launched 11:33:56.025041 run osmo-stp_10.42.42.5(pid=16684): Launched 11:33:56.141968 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:56.669270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16686): Launched 11:33:56.786582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:57.045253 run patchelf(pid=16687): Launched 11:33:57.215859 run osmo-stp_10.42.42.5(pid=16684): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16684)] 11:33:57.345825 run osmo-stp_10.42.42.5(pid=16684): stdout: | (launched: 2022-12-14_11:33:55.968702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:57.477329 run osmo-stp_10.42.42.5(pid=16684): stderr: | [0;m[38;5;43m20221214113356136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113356137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113356137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113356137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113356138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113356138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113356138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:57.608844 run osmo-stp_10.42.42.5(pid=16684): stdout: | (launched: 2022-12-14_11:33:55.968702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:57.734446 run osmo-stp_10.42.42.5(pid=16684): stderr: | [0;m[38;5;43m20221214113356136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113356137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113356137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113356137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113356138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113356138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113356138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:57.883110 run patchelf(pid=16687): Terminating (SIGINT) 11:33:58.054916 run patchelf(pid=16687): Terminated: ok {rc=0} 11:33:58.179307 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16684): Process ended prematurely: osmo-stp_10.42.42.5(pid=16684) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16684)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 11:33:58.188889 tst iperf3.py:8: Test FAILED (7.4 sec) 11:33:58.216811 run osmo-hlr_10.42.42.2(pid=16681): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16681)] 11:33:58.265637 run osmo-hlr_10.42.42.2(pid=16681): stdout: | (launched: 2022-12-14_11:33:55.014385) 11:33:58.315760 run osmo-hlr_10.42.42.2(pid=16681): stderr: | [0;m[1;31m20221214113355187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113355187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113355187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113355187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113355187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113355187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113355200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113355208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113355208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113355208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:58.366029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16676): Terminating (SIGTERM) 11:33:58.406616 run iperf3-srv_10.42.42.10(pid=16677): Terminating (SIGTERM) 11:33:58.447140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16680): Terminating (SIGTERM) 11:33:58.487584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16683): Terminating (SIGTERM) 11:33:58.527904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16686): Terminating (SIGTERM) 11:33:58.568582 --- ParallelTerminationStrategy: PID 16676 died... 11:33:58.588349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16676): Terminated: ok {rc=0} 11:33:58.633279 --- ParallelTerminationStrategy: PID 16677 died... 11:33:58.652376 run iperf3-srv_10.42.42.10(pid=16677): Terminated {rc=256} 11:33:58.696791 --- ParallelTerminationStrategy: PID 16680 died... 11:33:58.715913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16680): Terminated: ok {rc=0} 11:33:58.760376 --- ParallelTerminationStrategy: PID 16683 died... 11:33:58.779484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16683): Terminated: ok {rc=0} 11:33:58.823784 --- ParallelTerminationStrategy: PID 16686 died... 11:33:58.842843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16686): Terminated: ok {rc=0} 11:33:58.930332 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:34:00.083666 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:00.095704 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:34:00.154266 tst iperf3m4.py: using LAC 40611 11:34:00.287544 tst iperf3m4.py: using RAC 66 11:34:00.416726 tst iperf3m4.py: using CellId 40611 11:34:00.543645 tst iperf3m4.py: using BVCI 40612 11:34:00.663454 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:00.674981 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:00.686199 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:00.697429 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:00.708502 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:00.720020 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:00.731406 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:00.742522 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:00.753882 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:00.871479 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:00.997140 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:01.117095 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:01.241393 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:34:01.470128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:01.810406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16688): Launched 11:34:02.116318 run iperf3-srv_10.42.42.10(pid=16689): Launched 11:34:02.257584 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:34:02.479934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:02.811929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16690): Launched 11:34:03.099503 run iperf3-srv_10.42.42.10(pid=16691): Launched 11:34:03.222491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:34:03.444002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:03.774731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16692): Launched 11:34:04.061671 run iperf3-srv_10.42.42.10(pid=16693): Launched 11:34:04.185237 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:34:04.406924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:04.738594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16694): Launched 11:34:05.026348 run iperf3-srv_10.42.42.10(pid=16695): Launched 11:34:05.149735 tst iperf3m4.py:8: start network... 11:34:05.370762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:05.881738 run create_hlr_db(pid=16696): Launched 11:34:06.015180 bus /gobi_6: Setting Powered False 11:34:07.079899 run create_hlr_db(pid=16696): Terminated: ok {rc=0} 11:34:07.517670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16698): Launched 11:34:07.824559 run osmo-hlr_10.42.42.2(pid=16699): Launched 11:34:07.940148 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:08.475097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16701): Launched 11:34:08.780566 run osmo-stp_10.42.42.5(pid=16702): Launched 11:34:08.895945 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:09.423772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16704): Launched 11:34:09.541486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:09.799466 run patchelf(pid=16705): Launched 11:34:09.970263 run osmo-stp_10.42.42.5(pid=16702): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16702)] 11:34:10.100571 run osmo-stp_10.42.42.5(pid=16702): stdout: | (launched: 2022-12-14_11:34:08.723997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:10.231964 run osmo-stp_10.42.42.5(pid=16702): stderr: | [0;m[38;5;43m20221214113408894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113408894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113408894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113408895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113408895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113408895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113408895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:10.363436 run osmo-stp_10.42.42.5(pid=16702): stdout: | (launched: 2022-12-14_11:34:08.723997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:10.488632 run osmo-stp_10.42.42.5(pid=16702): stderr: | [0;m[38;5;43m20221214113408894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113408894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113408894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113408895 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113408895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113408895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113408895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:10.637807 run patchelf(pid=16705): Terminating (SIGINT) 11:34:10.809580 run patchelf(pid=16705): Terminated: ok {rc=0} 11:34:10.933470 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16702): Process ended prematurely: osmo-stp_10.42.42.5(pid=16702) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16702)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:34:10.942908 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:34:10.970487 run osmo-hlr_10.42.42.2(pid=16699): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16699)] 11:34:11.019088 run osmo-hlr_10.42.42.2(pid=16699): stdout: | (launched: 2022-12-14_11:34:07.768179) 11:34:11.069427 run osmo-hlr_10.42.42.2(pid=16699): stderr: | [0;m[1;31m20221214113407943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113407943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113407943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113407943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113407943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113407943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113407955 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113407964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113407964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113407964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:11.119872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16688): Terminating (SIGTERM) 11:34:11.160441 run iperf3-srv_10.42.42.10(pid=16689): Terminating (SIGTERM) 11:34:11.200848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16690): Terminating (SIGTERM) 11:34:11.241463 run iperf3-srv_10.42.42.10(pid=16691): Terminating (SIGTERM) 11:34:11.281889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16692): Terminating (SIGTERM) 11:34:11.322881 run iperf3-srv_10.42.42.10(pid=16693): Terminating (SIGTERM) 11:34:11.363324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16694): Terminating (SIGTERM) 11:34:11.403803 run iperf3-srv_10.42.42.10(pid=16695): Terminating (SIGTERM) 11:34:11.444216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16698): Terminating (SIGTERM) 11:34:11.484825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16701): Terminating (SIGTERM) 11:34:11.525255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16704): Terminating (SIGTERM) 11:34:11.565858 --- ParallelTerminationStrategy: PID 16688 died... 11:34:11.585564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16688): Terminated: ok {rc=0} 11:34:11.630225 --- ParallelTerminationStrategy: PID 16689 died... 11:34:11.649149 run iperf3-srv_10.42.42.10(pid=16689): Terminated {rc=256} 11:34:11.693468 --- ParallelTerminationStrategy: PID 16690 died... 11:34:11.712548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16690): Terminated: ok {rc=0} 11:34:11.756910 --- ParallelTerminationStrategy: PID 16691 died... 11:34:11.776271 run iperf3-srv_10.42.42.10(pid=16691): Terminated {rc=256} 11:34:11.820447 --- ParallelTerminationStrategy: PID 16692 died... 11:34:11.839529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16692): Terminated: ok {rc=0} 11:34:11.884225 --- ParallelTerminationStrategy: PID 16693 died... 11:34:11.903225 run iperf3-srv_10.42.42.10(pid=16693): Terminated {rc=256} 11:34:11.947444 --- ParallelTerminationStrategy: PID 16694 died... 11:34:11.966473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16694): Terminated: ok {rc=0} 11:34:12.010906 --- ParallelTerminationStrategy: PID 16695 died... 11:34:12.029951 run iperf3-srv_10.42.42.10(pid=16695): Terminated {rc=256} 11:34:12.074212 --- ParallelTerminationStrategy: PID 16698 died... 11:34:12.093419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16698): Terminated: ok {rc=0} 11:34:12.138171 --- ParallelTerminationStrategy: PID 16701 died... 11:34:12.157207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16701): Terminated: ok {rc=0} 11:34:12.201767 --- ParallelTerminationStrategy: PID 16704 died... 11:34:12.220786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16704): Terminated: ok {rc=0} 11:34:12.308521 bus /gobi_4: Setting Powered False 11:34:13.410392 bus /gobi_4: Setting Powered False 11:34:14.528904 bus /gobi_1: Setting Powered False 11:34:15.628921 bus /gobi_1: Setting Powered False 11:34:16.751591 bus /gobi_0: Setting Powered False 11:34:17.854542 bus /gobi_0: Setting Powered False 11:34:18.973922 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:34:20.078528 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:20.090511 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:34:20.149394 tst ping.py: using LAC 40612 11:34:20.277826 tst ping.py: using RAC 67 11:34:20.406226 tst ping.py: using CellId 40612 11:34:20.533544 tst ping.py: using BVCI 40613 11:34:20.651511 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:20.663120 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:20.674463 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:20.685814 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:20.696886 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:20.708353 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:20.719784 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:20.731027 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:20.846747 tst ping.py:19: start network... 11:34:21.048544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:21.514420 run create_hlr_db(pid=16706): Launched 11:34:21.630837 bus /gobi_6: Setting Powered False 11:34:22.691854 run create_hlr_db(pid=16706): Terminated: ok {rc=0} 11:34:23.137587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16708): Launched 11:34:23.461915 run osmo-hlr_10.42.42.2(pid=16709): Launched 11:34:23.585459 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:24.157119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16711): Launched 11:34:24.480444 run osmo-stp_10.42.42.5(pid=16712): Launched 11:34:24.602804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:25.159879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16714): Launched 11:34:25.283161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:25.555611 run patchelf(pid=16715): Launched 11:34:25.735239 run osmo-stp_10.42.42.5(pid=16712): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16712)] 11:34:25.871464 run osmo-stp_10.42.42.5(pid=16712): stdout: | (launched: 2022-12-14_11:34:24.420884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:26.010128 run osmo-stp_10.42.42.5(pid=16712): stderr: | [0;m[38;5;43m20221214113424610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113424610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113424610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113424611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113424611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113424611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113424611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:26.147980 run osmo-stp_10.42.42.5(pid=16712): stdout: | (launched: 2022-12-14_11:34:24.420884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:26.279475 run osmo-stp_10.42.42.5(pid=16712): stderr: | [0;m[38;5;43m20221214113424610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113424610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113424610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113424611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113424611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113424611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113424611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:26.435845 run patchelf(pid=16715): Terminating (SIGINT) 11:34:26.616193 run patchelf(pid=16715): Terminated: ok {rc=0} 11:34:26.746770 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16712): Process ended prematurely: osmo-stp_10.42.42.5(pid=16712) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16712)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 11:34:26.756185 tst ping.py:22: Test FAILED (6.7 sec) 11:34:26.784409 run osmo-hlr_10.42.42.2(pid=16709): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16709)] 11:34:26.835007 run osmo-hlr_10.42.42.2(pid=16709): stdout: | (launched: 2022-12-14_11:34:23.402633) 11:34:26.887053 run osmo-hlr_10.42.42.2(pid=16709): stderr: | [0;m[1;31m20221214113423597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113423597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113423597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113423598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113423598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113423598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113423609 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113423618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113423618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113423618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:26.939345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16708): Terminating (SIGTERM) 11:34:26.981690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16711): Terminating (SIGTERM) 11:34:27.023961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16714): Terminating (SIGTERM) 11:34:27.066360 --- ParallelTerminationStrategy: PID 16708 died... 11:34:27.086653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16708): Terminated: ok {rc=0} 11:34:27.133172 --- ParallelTerminationStrategy: PID 16711 died... 11:34:27.152838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16711): Terminated: ok {rc=0} 11:34:27.198962 --- ParallelTerminationStrategy: PID 16714 died... 11:34:27.218553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16714): Terminated: ok {rc=0} 11:34:27.310340 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:34:28.398179 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:28.410163 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:34:28.502014 tst ping_idle_ping.py: using LAC 40613 11:34:28.623752 tst ping_idle_ping.py: using RAC 68 11:34:28.741110 tst ping_idle_ping.py: using CellId 40613 11:34:28.857386 tst ping_idle_ping.py: using BVCI 40614 11:34:28.966628 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:28.977518 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:28.988294 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:28.998901 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:29.009826 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:29.021233 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:29.032457 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:29.043526 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:29.163524 tst ping_idle_ping.py:24: start network... 11:34:29.382325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:29.887260 run create_hlr_db(pid=16716): Launched 11:34:30.019904 bus /gobi_6: Setting Powered False 11:34:31.082417 run create_hlr_db(pid=16716): Terminated: ok {rc=0} 11:34:31.544180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16718): Launched 11:34:31.885712 run osmo-hlr_10.42.42.2(pid=16719): Launched 11:34:32.149394 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:32.789232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16721): Launched 11:34:33.112367 run osmo-stp_10.42.42.5(pid=16722): Launched 11:34:33.234710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:33.793973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16724): Launched 11:34:33.917373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:34.192383 run patchelf(pid=16725): Launched 11:34:34.374161 run osmo-stp_10.42.42.5(pid=16722): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16722)] 11:34:34.511792 run osmo-stp_10.42.42.5(pid=16722): stdout: | (launched: 2022-12-14_11:34:33.052929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:34.650835 run osmo-stp_10.42.42.5(pid=16722): stderr: | [0;m[38;5;43m20221214113433241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113433241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113433241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113433242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113433242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113433242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113433242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:34.790110 run osmo-stp_10.42.42.5(pid=16722): stdout: | (launched: 2022-12-14_11:34:33.052929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:34.922420 run osmo-stp_10.42.42.5(pid=16722): stderr: | [0;m[38;5;43m20221214113433241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113433241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113433241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113433242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113433242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113433242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113433242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:35.079321 run patchelf(pid=16725): Terminating (SIGINT) 11:34:35.260404 run patchelf(pid=16725): Terminated: ok {rc=0} 11:34:35.390929 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16722): Process ended prematurely: osmo-stp_10.42.42.5(pid=16722) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16722)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:34:35.400410 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 11:34:35.428372 run osmo-hlr_10.42.42.2(pid=16719): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16719)] 11:34:35.478634 run osmo-hlr_10.42.42.2(pid=16719): stdout: | (launched: 2022-12-14_11:34:31.824694) 11:34:35.530607 run osmo-hlr_10.42.42.2(pid=16719): stderr: | [0;m[1;31m20221214113432049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113432049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113432049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113432049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113432049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113432049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113432062 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113432074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113432076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113432082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:35.582871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16718): Terminating (SIGTERM) 11:34:35.624934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16721): Terminating (SIGTERM) 11:34:35.667393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16724): Terminating (SIGTERM) 11:34:35.710100 --- ParallelTerminationStrategy: PID 16718 died... 11:34:35.730103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16718): Terminated: ok {rc=0} 11:34:35.776720 --- ParallelTerminationStrategy: PID 16721 died... 11:34:35.796501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16721): Terminated: ok {rc=0} 11:34:35.842890 --- ParallelTerminationStrategy: PID 16724 died... 11:34:35.862537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16724): Terminated: ok {rc=0} 11:34:35.950906 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:34:37.245454 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:34:37.251842 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:34:37.273070 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:34:37.312339 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:34:37.401134 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:34:37.422434 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:34:37.461943 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:34:38.057915 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:34:38.110364 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.121649 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:34:38.180302 tst cs_paging_gprs_active.py: using LAC 40614 11:34:38.310152 tst cs_paging_gprs_active.py: using RAC 69 11:34:38.439622 tst cs_paging_gprs_active.py: using CellId 40614 11:34:38.568403 tst cs_paging_gprs_active.py: using BVCI 40615 11:34:38.687862 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.699154 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.710258 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.721394 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.732407 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.743580 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.754773 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.766205 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.777436 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:34:38.897735 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:34:39.018441 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:34:39.225758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:39.535217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16732): Launched 11:34:39.803686 run iperf3-srv_10.42.42.10(pid=16733): Launched 11:34:39.918936 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:34:40.123487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:40.430759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16734): Launched 11:34:40.700885 run iperf3-srv_10.42.42.10(pid=16735): Launched 11:34:40.816509 tst cs_paging_gprs_active.py:38: start network... 11:34:41.020662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:41.495308 run create_hlr_db(pid=16736): Launched 11:34:41.612514 bus /gobi_6: Setting Powered False 11:34:42.674578 run create_hlr_db(pid=16736): Terminated: ok {rc=0} 11:34:43.102505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16738): Launched 11:34:43.409845 run osmo-hlr_10.42.42.2(pid=16739): Launched 11:34:43.526646 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:44.064861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16741): Launched 11:34:44.371070 run osmo-stp_10.42.42.5(pid=16742): Launched 11:34:44.488289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:45.017111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16744): Launched 11:34:45.134620 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:45.394377 run patchelf(pid=16745): Launched 11:34:45.567420 run osmo-stp_10.42.42.5(pid=16742): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16742)] 11:34:45.697785 run osmo-stp_10.42.42.5(pid=16742): stdout: | (launched: 2022-12-14_11:34:44.314487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:45.829783 run osmo-stp_10.42.42.5(pid=16742): stderr: | [0;m[38;5;43m20221214113444481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113444482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113444482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113444482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113444483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113444483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113444483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:45.977083 run osmo-stp_10.42.42.5(pid=16742): stdout: | (launched: 2022-12-14_11:34:44.314487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:46.106768 run osmo-stp_10.42.42.5(pid=16742): stderr: | [0;m[38;5;43m20221214113444481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113444482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113444482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113444482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113444483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113444483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113444483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:46.260480 run patchelf(pid=16745): Terminating (SIGINT) 11:34:46.439133 run patchelf(pid=16745): Terminated: ok {rc=0} 11:34:46.567728 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16742): Process ended prematurely: osmo-stp_10.42.42.5(pid=16742) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16742)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:34:46.578506 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:34:46.607096 run osmo-hlr_10.42.42.2(pid=16739): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16739)] 11:34:46.660186 run osmo-hlr_10.42.42.2(pid=16739): stdout: | (launched: 2022-12-14_11:34:43.352748) 11:34:46.712584 run osmo-hlr_10.42.42.2(pid=16739): stderr: | [0;m[1;31m20221214113443527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113443527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113443527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113443527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113443527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113443527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113443539 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113443547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113443547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113443547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:46.765719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16732): Terminating (SIGTERM) 11:34:46.807635 run iperf3-srv_10.42.42.10(pid=16733): Terminating (SIGTERM) 11:34:46.851744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16734): Terminating (SIGTERM) 11:34:46.895392 run iperf3-srv_10.42.42.10(pid=16735): Terminating (SIGTERM) 11:34:46.939798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16738): Terminating (SIGTERM) 11:34:46.984239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16741): Terminating (SIGTERM) 11:34:47.027287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16744): Terminating (SIGTERM) 11:34:47.071851 --- ParallelTerminationStrategy: PID 16732 died... 11:34:47.093259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16732): Terminated: ok {rc=0} 11:34:47.140019 --- ParallelTerminationStrategy: PID 16733 died... 11:34:47.160997 run iperf3-srv_10.42.42.10(pid=16733): Terminated {rc=256} 11:34:47.208113 --- ParallelTerminationStrategy: PID 16734 died... 11:34:47.228008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16734): Terminated: ok {rc=0} 11:34:47.273237 --- ParallelTerminationStrategy: PID 16735 died... 11:34:47.293081 run iperf3-srv_10.42.42.10(pid=16735): Terminated {rc=256} 11:34:47.338058 --- ParallelTerminationStrategy: PID 16738 died... 11:34:47.357448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16738): Terminated: ok {rc=0} 11:34:47.401551 --- ParallelTerminationStrategy: PID 16741 died... 11:34:47.420604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16741): Terminated: ok {rc=0} 11:34:47.464837 --- ParallelTerminationStrategy: PID 16744 died... 11:34:47.484305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16744): Terminated: ok {rc=0} 11:34:47.569055 bus /gobi_0: Setting Powered False 11:34:48.668149 bus /gobi_0: Setting Powered False 11:34:49.787261 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:34:50.933950 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:50.945708 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:34:51.005686 tst iperf3.py: using LAC 40615 11:34:51.134850 tst iperf3.py: using RAC 70 11:34:51.265317 tst iperf3.py: using CellId 40615 11:34:51.395346 tst iperf3.py: using BVCI 40616 11:34:51.507411 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:51.518424 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:51.529138 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:51.539682 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:51.550711 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:51.562130 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:51.573202 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:51.583944 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:51.595048 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:34:51.712330 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:34:51.918866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:52.228009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16746): Launched 11:34:52.497187 run iperf3-srv_10.42.42.10(pid=16747): Launched 11:34:52.613165 tst iperf3.py:8: start network... 11:34:52.818409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:53.292583 run create_hlr_db(pid=16748): Launched 11:34:53.409382 bus /gobi_6: Setting Powered False 11:34:54.469598 run create_hlr_db(pid=16748): Terminated: ok {rc=0} 11:34:54.920372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16750): Launched 11:34:55.249570 run osmo-hlr_10.42.42.2(pid=16751): Launched 11:34:55.378685 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:55.959404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16753): Launched 11:34:56.289537 run osmo-stp_10.42.42.5(pid=16754): Launched 11:34:56.415617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:56.984444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16756): Launched 11:34:57.112051 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:57.391098 run patchelf(pid=16757): Launched 11:34:57.575685 run osmo-stp_10.42.42.5(pid=16754): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16754)] 11:34:57.715229 run osmo-stp_10.42.42.5(pid=16754): stdout: | (launched: 2022-12-14_11:34:56.229499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:57.856025 run osmo-stp_10.42.42.5(pid=16754): stderr: | [0;m[38;5;43m20221214113456419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113456419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113456419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113456420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113456420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113456420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113456420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:57.996348 run osmo-stp_10.42.42.5(pid=16754): stdout: | (launched: 2022-12-14_11:34:56.229499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:58.130920 run osmo-stp_10.42.42.5(pid=16754): stderr: | [0;m[38;5;43m20221214113456419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113456419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113456419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113456420 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113456420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113456420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113456420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:58.290437 run patchelf(pid=16757): Terminating (SIGINT) 11:34:58.474913 run patchelf(pid=16757): Terminated: ok {rc=0} 11:34:58.608232 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16754): Process ended prematurely: osmo-stp_10.42.42.5(pid=16754) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16754)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 11:34:58.618731 tst iperf3.py:8: Test FAILED (7.7 sec) 11:34:58.647818 run osmo-hlr_10.42.42.2(pid=16751): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16751)] 11:34:58.698181 run osmo-hlr_10.42.42.2(pid=16751): stdout: | (launched: 2022-12-14_11:34:55.189538) 11:34:58.750314 run osmo-hlr_10.42.42.2(pid=16751): stderr: | [0;m[1;31m20221214113455399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113455399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113455399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113455399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113455399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113455399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113455416 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113455440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113455440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113455440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:58.802837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16746): Terminating (SIGTERM) 11:34:58.845035 run iperf3-srv_10.42.42.10(pid=16747): Terminating (SIGTERM) 11:34:58.887609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16750): Terminating (SIGTERM) 11:34:58.930134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16753): Terminating (SIGTERM) 11:34:58.972750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16756): Terminating (SIGTERM) 11:34:59.015234 --- ParallelTerminationStrategy: PID 16746 died... 11:34:59.035443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16746): Terminated: ok {rc=0} 11:34:59.082134 --- ParallelTerminationStrategy: PID 16747 died... 11:34:59.101844 run iperf3-srv_10.42.42.10(pid=16747): Terminated {rc=256} 11:34:59.148563 --- ParallelTerminationStrategy: PID 16750 died... 11:34:59.168378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16750): Terminated: ok {rc=0} 11:34:59.214851 --- ParallelTerminationStrategy: PID 16753 died... 11:34:59.234676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16753): Terminated: ok {rc=0} 11:34:59.281354 --- ParallelTerminationStrategy: PID 16756 died... 11:34:59.301294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16756): Terminated: ok {rc=0} 11:34:59.390846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:35:00.538659 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:00.550202 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:35:00.606123 tst iperf3m4.py: using LAC 40616 11:35:00.727777 tst iperf3m4.py: using RAC 71 11:35:00.849557 tst iperf3m4.py: using CellId 40616 11:35:00.976222 tst iperf3m4.py: using BVCI 40617 11:35:01.091763 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:01.103906 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:01.115736 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:01.127594 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:01.140522 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:01.153585 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:01.166691 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:01.179360 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:01.192169 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:01.315532 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:01.446400 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:01.568385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:01.691714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:35:01.905705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:35:02.225653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16761): Launched 11:35:02.510832 run iperf3-srv_10.42.42.10(pid=16762): Launched 11:35:02.627127 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:35:02.832659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:35:03.140801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16763): Launched 11:35:03.410318 run iperf3-srv_10.42.42.10(pid=16764): Launched 11:35:03.526875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:35:03.730846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:35:04.037720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16765): Launched 11:35:04.305078 run iperf3-srv_10.42.42.10(pid=16766): Launched 11:35:04.419728 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:35:04.623701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:35:04.932259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16767): Launched 11:35:05.200174 run iperf3-srv_10.42.42.10(pid=16768): Launched 11:35:05.316824 tst iperf3m4.py:8: start network... 11:35:05.521157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:05.995135 run create_hlr_db(pid=16769): Launched 11:35:06.111677 bus /gobi_6: Setting Powered False 11:35:07.176247 run create_hlr_db(pid=16769): Terminated: ok {rc=0} 11:35:07.634878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16771): Launched 11:35:07.966751 run osmo-hlr_10.42.42.2(pid=16772): Launched 11:35:08.093682 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:08.666577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16774): Launched 11:35:08.997531 run osmo-stp_10.42.42.5(pid=16775): Launched 11:35:09.122465 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:09.693769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16777): Launched 11:35:09.822196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:10.103459 run patchelf(pid=16778): Launched 11:35:10.288771 run osmo-stp_10.42.42.5(pid=16775): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16775)] 11:35:10.428531 run osmo-stp_10.42.42.5(pid=16775): stdout: | (launched: 2022-12-14_11:35:08.936509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:10.569916 run osmo-stp_10.42.42.5(pid=16775): stderr: | [0;m[38;5;43m20221214113509127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113509127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113509127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113509128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113509128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113509129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113509129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:10.712385 run osmo-stp_10.42.42.5(pid=16775): stdout: | (launched: 2022-12-14_11:35:08.936509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:10.847951 run osmo-stp_10.42.42.5(pid=16775): stderr: | [0;m[38;5;43m20221214113509127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113509127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113509127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113509128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113509128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113509129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113509129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:11.008051 run patchelf(pid=16778): Terminating (SIGINT) 11:35:11.193124 run patchelf(pid=16778): Terminated: ok {rc=0} 11:35:11.326207 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16775): Process ended prematurely: osmo-stp_10.42.42.5(pid=16775) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16775)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:35:11.336510 tst iperf3m4.py:8: Test FAILED (10.8 sec) 11:35:11.365625 run osmo-hlr_10.42.42.2(pid=16772): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16772)] 11:35:11.416131 run osmo-hlr_10.42.42.2(pid=16772): stdout: | (launched: 2022-12-14_11:35:07.906499) 11:35:11.468243 run osmo-hlr_10.42.42.2(pid=16772): stderr: | [0;m[1;31m20221214113508099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113508099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113508099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113508099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113508099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113508099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113508112 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113508121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113508121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113508121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:11.520762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16761): Terminating (SIGTERM) 11:35:11.562981 run iperf3-srv_10.42.42.10(pid=16762): Terminating (SIGTERM) 11:35:11.606554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16763): Terminating (SIGTERM) 11:35:11.649363 run iperf3-srv_10.42.42.10(pid=16764): Terminating (SIGTERM) 11:35:11.691291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16765): Terminating (SIGTERM) 11:35:11.733271 run iperf3-srv_10.42.42.10(pid=16766): Terminating (SIGTERM) 11:35:11.775402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16767): Terminating (SIGTERM) 11:35:11.817611 run iperf3-srv_10.42.42.10(pid=16768): Terminating (SIGTERM) 11:35:11.859930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16771): Terminating (SIGTERM) 11:35:11.901934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16774): Terminating (SIGTERM) 11:35:11.944259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16777): Terminating (SIGTERM) 11:35:11.986483 --- ParallelTerminationStrategy: PID 16761 died... 11:35:12.006626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16761): Terminated: ok {rc=0} 11:35:12.053071 --- ParallelTerminationStrategy: PID 16762 died... 11:35:12.072649 run iperf3-srv_10.42.42.10(pid=16762): Terminated {rc=256} 11:35:12.118811 --- ParallelTerminationStrategy: PID 16763 died... 11:35:12.138536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16763): Terminated: ok {rc=0} 11:35:12.184685 --- ParallelTerminationStrategy: PID 16764 died... 11:35:12.204342 run iperf3-srv_10.42.42.10(pid=16764): Terminated {rc=256} 11:35:12.250426 --- ParallelTerminationStrategy: PID 16765 died... 11:35:12.270059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16765): Terminated: ok {rc=0} 11:35:12.316136 --- ParallelTerminationStrategy: PID 16766 died... 11:35:12.335792 run iperf3-srv_10.42.42.10(pid=16766): Terminated {rc=256} 11:35:12.381969 --- ParallelTerminationStrategy: PID 16767 died... 11:35:12.401562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16767): Terminated: ok {rc=0} 11:35:12.447728 --- ParallelTerminationStrategy: PID 16768 died... 11:35:12.467320 run iperf3-srv_10.42.42.10(pid=16768): Terminated {rc=256} 11:35:12.513428 --- ParallelTerminationStrategy: PID 16771 died... 11:35:12.533170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16771): Terminated: ok {rc=0} 11:35:12.579353 --- ParallelTerminationStrategy: PID 16774 died... 11:35:12.599022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16774): Terminated: ok {rc=0} 11:35:12.645481 --- ParallelTerminationStrategy: PID 16777 died... 11:35:12.665187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16777): Terminated: ok {rc=0} 11:35:12.753075 bus /gobi_4: Setting Powered False 11:35:13.852599 bus /gobi_4: Setting Powered False 11:35:14.967963 bus /gobi_1: Setting Powered False 11:35:16.076824 bus /gobi_1: Setting Powered False 11:35:17.214576 bus /gobi_0: Setting Powered False 11:35:18.314920 bus /gobi_0: Setting Powered False 11:35:19.433713 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:35:20.539720 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:20.551722 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:35:20.616027 tst ping.py: using LAC 40617 11:35:20.743625 tst ping.py: using RAC 72 11:35:20.868612 tst ping.py: using CellId 40617 11:35:20.993678 tst ping.py: using BVCI 40618 11:35:21.111763 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:21.123291 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:21.134527 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:21.145717 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:21.156745 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:21.167848 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:21.179208 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:21.190392 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:21.311516 tst ping.py:19: start network... 11:35:21.529948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:22.032636 run create_hlr_db(pid=16779): Launched 11:35:22.165006 bus /gobi_6: Setting Powered False 11:35:23.229860 run create_hlr_db(pid=16779): Terminated: ok {rc=0} 11:35:23.665043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16781): Launched 11:35:23.968121 run osmo-hlr_10.42.42.2(pid=16782): Launched 11:35:24.082486 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:24.621675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16784): Launched 11:35:24.923765 run osmo-stp_10.42.42.5(pid=16785): Launched 11:35:25.038251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:25.558856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16787): Launched 11:35:25.685692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:25.960879 run patchelf(pid=16788): Launched 11:35:26.142266 run osmo-stp_10.42.42.5(pid=16785): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16785)] 11:35:26.279095 run osmo-stp_10.42.42.5(pid=16785): stdout: | (launched: 2022-12-14_11:35:24.867726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:26.418008 run osmo-stp_10.42.42.5(pid=16785): stderr: | [0;m[38;5;43m20221214113525035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113525035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113525035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113525035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113525036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113525036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113525036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:26.556925 run osmo-stp_10.42.42.5(pid=16785): stdout: | (launched: 2022-12-14_11:35:24.867726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:26.689721 run osmo-stp_10.42.42.5(pid=16785): stderr: | [0;m[38;5;43m20221214113525035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113525035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113525035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113525035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113525036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113525036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113525036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:26.846993 run patchelf(pid=16788): Terminating (SIGINT) 11:35:27.028453 run patchelf(pid=16788): Terminated: ok {rc=0} 11:35:27.159267 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16785): Process ended prematurely: osmo-stp_10.42.42.5(pid=16785) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16785)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 11:35:27.168803 tst ping.py:22: Test FAILED (6.6 sec) 11:35:27.197043 run osmo-hlr_10.42.42.2(pid=16782): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16782)] 11:35:27.247114 run osmo-hlr_10.42.42.2(pid=16782): stdout: | (launched: 2022-12-14_11:35:23.912338) 11:35:27.298752 run osmo-hlr_10.42.42.2(pid=16782): stderr: | [0;m[1;31m20221214113524083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113524083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113524083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113524083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113524083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113524083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113524096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113524106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113524107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113524107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:27.350869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16781): Terminating (SIGTERM) 11:35:27.393022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16784): Terminating (SIGTERM) 11:35:27.435448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16787): Terminating (SIGTERM) 11:35:27.478122 --- ParallelTerminationStrategy: PID 16781 died... 11:35:27.498238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16781): Terminated: ok {rc=0} 11:35:27.544709 --- ParallelTerminationStrategy: PID 16784 died... 11:35:27.564406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16784): Terminated: ok {rc=0} 11:35:27.611019 --- ParallelTerminationStrategy: PID 16787 died... 11:35:27.630840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16787): Terminated: ok {rc=0} 11:35:27.720294 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:35:28.809651 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:28.821698 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:35:28.886590 tst ping_idle_ping.py: using LAC 40618 11:35:29.008142 tst ping_idle_ping.py: using RAC 73 11:35:29.125653 tst ping_idle_ping.py: using CellId 40618 11:35:29.251751 tst ping_idle_ping.py: using BVCI 40619 11:35:29.369872 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:29.381410 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:29.392540 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:29.403925 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:29.415440 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:29.426594 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:29.438009 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:29.449169 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:29.569760 tst ping_idle_ping.py:24: start network... 11:35:29.789698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:30.295716 run create_hlr_db(pid=16789): Launched 11:35:30.429563 bus /gobi_6: Setting Powered False 11:35:31.506038 run create_hlr_db(pid=16789): Terminated: ok {rc=0} 11:35:32.020673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16791): Launched 11:35:32.361983 run osmo-hlr_10.42.42.2(pid=16792): Launched 11:35:32.487075 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:33.046592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16794): Launched 11:35:33.372837 run osmo-stp_10.42.42.5(pid=16795): Launched 11:35:33.495614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:34.058432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16797): Launched 11:35:34.184063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:34.458940 run patchelf(pid=16798): Launched 11:35:34.640691 run osmo-stp_10.42.42.5(pid=16795): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16795)] 11:35:34.778663 run osmo-stp_10.42.42.5(pid=16795): stdout: | (launched: 2022-12-14_11:35:33.313094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:34.919036 run osmo-stp_10.42.42.5(pid=16795): stderr: | [0;m[38;5;43m20221214113533502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113533502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113533502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113533502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113533503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113533503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113533503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:35.058987 run osmo-stp_10.42.42.5(pid=16795): stdout: | (launched: 2022-12-14_11:35:33.313094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:35.191705 run osmo-stp_10.42.42.5(pid=16795): stderr: | [0;m[38;5;43m20221214113533502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113533502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113533502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113533502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113533503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113533503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113533503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:35.349230 run patchelf(pid=16798): Terminating (SIGINT) 11:35:35.532192 run patchelf(pid=16798): Terminated: ok {rc=0} 11:35:35.664213 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16795): Process ended prematurely: osmo-stp_10.42.42.5(pid=16795) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16795)] [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:35:35.673973 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 11:35:35.702186 run osmo-hlr_10.42.42.2(pid=16792): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16792)] 11:35:35.752748 run osmo-hlr_10.42.42.2(pid=16792): stdout: | (launched: 2022-12-14_11:35:32.301615) 11:35:35.805261 run osmo-hlr_10.42.42.2(pid=16792): stderr: | [0;m[1;31m20221214113532496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113532496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113532496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113532496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113532496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113532496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113532508 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113532518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113532518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113532518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:35.858089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16791): Terminating (SIGTERM) 11:35:35.900555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16794): Terminating (SIGTERM) 11:35:35.943180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16797): Terminating (SIGTERM) 11:35:35.986122 --- ParallelTerminationStrategy: PID 16791 died... 11:35:36.006497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16791): Terminated: ok {rc=0} 11:35:36.053246 --- ParallelTerminationStrategy: PID 16794 died... 11:35:36.073138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16794): Terminated: ok {rc=0} 11:35:36.119526 --- ParallelTerminationStrategy: PID 16797 died... 11:35:36.139358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16797): Terminated: ok {rc=0} 11:35:36.227900 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:35:37.519197 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:37.526306 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:35:37.547227 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:35:37.583228 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:35:37.635096 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:35:37.655860 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:35:37.690578 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:35:38.248374 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:35:38.253754 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:38.265029 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:35:38.329849 tst switch_tch_pdch.py: using LAC 40619 11:35:38.468288 tst switch_tch_pdch.py: using RAC 74 11:35:38.598186 tst switch_tch_pdch.py: using CellId 40619 11:35:38.727012 tst switch_tch_pdch.py: using BVCI 40620 11:35:38.845926 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:38.857816 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:38.869339 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:38.880621 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:38.891969 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:38.903433 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:38.915005 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:38.926746 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:35:39.044888 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:35:39.162502 tst switch_tch_pdch.py:51: start network... 11:35:39.364832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:39.831412 run create_hlr_db(pid=16802): Launched 11:35:39.946919 bus /gobi_6: Setting Powered False 11:35:41.007807 run create_hlr_db(pid=16802): Terminated: ok {rc=0} 11:35:41.431374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16804): Launched 11:35:41.735097 run osmo-hlr_10.42.42.2(pid=16805): Launched 11:35:41.849140 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:42.384075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16807): Launched 11:35:42.685544 run osmo-stp_10.42.42.5(pid=16808): Launched 11:35:42.800352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:43.320898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16810): Launched 11:35:43.435911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:43.691001 run patchelf(pid=16811): Launched 11:35:43.860471 run osmo-stp_10.42.42.5(pid=16808): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16808)] 11:35:43.988485 run osmo-stp_10.42.42.5(pid=16808): stdout: | (launched: 2022-12-14_11:35:42.629699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:44.118682 run osmo-stp_10.42.42.5(pid=16808): stderr: | [0;m[38;5;43m20221214113542795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113542795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113542795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113542796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113542796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113542796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113542797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:44.248476 run osmo-stp_10.42.42.5(pid=16808): stdout: | (launched: 2022-12-14_11:35:42.629699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:44.372142 run osmo-stp_10.42.42.5(pid=16808): stderr: | [0;m[38;5;43m20221214113542795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113542795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113542795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113542796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113542796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113542796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113542797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:44.518484 run patchelf(pid=16811): Terminating (SIGINT) 11:35:44.689069 run patchelf(pid=16811): Terminated: ok {rc=0} 11:35:44.811567 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16808): Process ended prematurely: osmo-stp_10.42.42.5(pid=16808) [trial-2404↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16808)] [trial-2404↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:35:44.820449 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 11:35:44.847390 run osmo-hlr_10.42.42.2(pid=16805): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16805)] 11:35:44.896203 run osmo-hlr_10.42.42.2(pid=16805): stdout: | (launched: 2022-12-14_11:35:41.679179) 11:35:44.946743 run osmo-hlr_10.42.42.2(pid=16805): stderr: | [0;m[1;31m20221214113541852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113541852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113541852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113541852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113541852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113541852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113541864 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113541872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113541872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113541872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:44.997814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16804): Terminating (SIGTERM) 11:35:45.038723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16807): Terminating (SIGTERM) 11:35:45.079549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16810): Terminating (SIGTERM) 11:35:45.120619 --- ParallelTerminationStrategy: PID 16804 died... 11:35:45.140453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16804): Terminated: ok {rc=0} 11:35:45.185181 --- ParallelTerminationStrategy: PID 16807 died... 11:35:45.204245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16807): Terminated: ok {rc=0} 11:35:45.249285 --- ParallelTerminationStrategy: PID 16810 died... 11:35:45.268263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16810): Terminated: ok {rc=0} 11:35:45.355052 bus /gobi_0: Setting Powered False 11:35:46.463162 bus /gobi_0: Setting Powered False 11:35:47.598346 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:35:48.835272 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:48.841032 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:35:48.861389 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:35:48.896309 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:35:48.949130 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:35:48.970707 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:35:49.006328 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:35:49.558724 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:35:49.564433 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:49.575535 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:35:49.632545 tst switch_tch_pdch.py: using LAC 40620 11:35:49.752769 tst switch_tch_pdch.py: using RAC 75 11:35:49.872349 tst switch_tch_pdch.py: using CellId 40620 11:35:49.990338 tst switch_tch_pdch.py: using BVCI 40621 11:35:50.101285 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:50.112129 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:50.123019 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:50.133753 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:50.144675 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:50.156182 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:50.167376 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:50.178466 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:35:50.294429 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:35:50.410673 tst switch_tch_pdch.py:51: start network... 11:35:50.612530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:51.054461 run create_hlr_db(pid=16817): Launched 11:35:51.171788 bus /gobi_6: Setting Powered False 11:35:52.231968 run create_hlr_db(pid=16817): Terminated: ok {rc=0} 11:35:52.630255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16819): Launched 11:35:52.935070 run osmo-hlr_10.42.42.2(pid=16820): Launched 11:35:53.052024 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:53.561204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16822): Launched 11:35:53.862808 run osmo-stp_10.42.42.5(pid=16823): Launched 11:35:53.978005 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:54.473319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16825): Launched 11:35:54.588927 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:54.844320 run patchelf(pid=16826): Launched 11:35:55.012544 run osmo-stp_10.42.42.5(pid=16823): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16823)] 11:35:55.142359 run osmo-stp_10.42.42.5(pid=16823): stdout: | (launched: 2022-12-14_11:35:53.806932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:55.272874 run osmo-stp_10.42.42.5(pid=16823): stderr: | [0;m[38;5;43m20221214113553976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113553976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113553977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113553977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113553978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113553978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113553978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:55.403174 run osmo-stp_10.42.42.5(pid=16823): stdout: | (launched: 2022-12-14_11:35:53.806932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:55.526994 run osmo-stp_10.42.42.5(pid=16823): stderr: | [0;m[38;5;43m20221214113553976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113553976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113553977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113553977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113553978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113553978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113553978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:55.673735 run patchelf(pid=16826): Terminating (SIGINT) 11:35:55.844048 run patchelf(pid=16826): Terminated: ok {rc=0} 11:35:55.966778 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16823): Process ended prematurely: osmo-stp_10.42.42.5(pid=16823) [trial-2404↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16823)] [trial-2404↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:35:55.975761 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 11:35:56.002534 run osmo-hlr_10.42.42.2(pid=16820): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16820)] 11:35:56.051465 run osmo-hlr_10.42.42.2(pid=16820): stdout: | (launched: 2022-12-14_11:35:52.878814) 11:35:56.101773 run osmo-hlr_10.42.42.2(pid=16820): stderr: | [0;m[1;31m20221214113553052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113553052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113553052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113553052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113553053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113553053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113553069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113553077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113553077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113553077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:56.152434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16819): Terminating (SIGTERM) 11:35:56.193323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16822): Terminating (SIGTERM) 11:35:56.233964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16825): Terminating (SIGTERM) 11:35:56.274875 --- ParallelTerminationStrategy: PID 16819 died... 11:35:56.294599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16819): Terminated: ok {rc=0} 11:35:56.339544 --- ParallelTerminationStrategy: PID 16822 died... 11:35:56.358737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16822): Terminated: ok {rc=0} 11:35:56.403173 --- ParallelTerminationStrategy: PID 16825 died... 11:35:56.422271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16825): Terminated: ok {rc=0} 11:35:56.509150 bus /gobi_0: Setting Powered False 11:35:57.610623 bus /gobi_0: Setting Powered False 11:35:58.729330 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_sms:oc2g --------------------------------------------------------------------- 11:35:59.970073 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:59.974080 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 11:35:59.995030 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 11:36:00.002026 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 11:36:00.055459 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 11:36:00.076771 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 11:36:00.083807 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 11:36:00.621813 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 11:36:00.627797 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 11:36:00.639524 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 11:36:00.674217 tst mo_mt_sms.py: using LAC 40621 11:36:00.803133 tst mo_mt_sms.py: using RAC 76 11:36:00.948722 tst mo_mt_sms.py: using CellId 40621 11:36:01.081280 tst mo_mt_sms.py: using BVCI 40622 11:36:01.199165 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 11:36:01.320069 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 11:36:01.461960 tst mo_mt_sms.py:9: start nitb and bts... 11:36:01.673668 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:36:02.311934 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16830): Launched 11:36:02.615723 run osmo-nitb_10.42.42.2(pid=16831): Launched 11:36:02.783850 run osmo-nitb_10.42.42.2(pid=16831): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16831)] 11:36:02.919838 run osmo-nitb_10.42.42.2(pid=16831): stdout: | (launched: 2022-12-14_11:36:02.559669) 11:36:03.057443 run osmo-nitb_10.42.42.2(pid=16831): stderr: | (launched: 2022-12-14_11:36:02.604462) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:36:03.195189 run osmo-nitb_10.42.42.2(pid=16831): stdout: | (launched: 2022-12-14_11:36:02.559669) 11:36:03.326377 run osmo-nitb_10.42.42.2(pid=16831): stderr: | (launched: 2022-12-14_11:36:02.604462) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16831): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16831) [trial-2404↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16831)] 11:36:03.730511 tst osmo-nitb_10.42.42.2(pid=16831): stdout: | (launched: 2022-12-14_11:36:02.559669) 11:36:03.852443 tst osmo-nitb_10.42.42.2(pid=16831): stderr: | (launched: 2022-12-14_11:36:02.604462) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:36:03.995895 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=16831): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16831) [trial-2404↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16831)] [trial-2404↪nitb_sms:oc2g↪mo_mt_sms.py:11] 11:36:04.004507 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 11:36:04.011260 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16830): Terminating (SIGTERM) 11:36:04.220731 --- ParallelTerminationStrategy: PID 16830 died... 11:36:04.241639 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16830): Terminated: ok {rc=0} 11:36:04.328645 bus /sierra_3: Setting Powered False 11:36:05.429324 bus /sierra_3: Setting Powered False 11:36:06.546399 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 sms:oc2g --------------------------------------------------------------------- 11:36:07.730770 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:07.735208 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 11:36:07.755419 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 11:36:07.782769 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 11:36:07.835923 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 11:36:07.857548 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 11:36:07.885737 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 11:36:08.426492 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 sms:oc2g mo_mt_sms.py ---------------------------------------------- 11:36:08.432399 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:36:08.443517 tst sms:oc2g: Using 1 x bts (candidates: 1) 11:36:08.477360 tst mo_mt_sms.py: using LAC 40622 11:36:08.597244 tst mo_mt_sms.py: using RAC 77 11:36:08.715029 tst mo_mt_sms.py: using CellId 40622 11:36:08.836246 tst mo_mt_sms.py: using BVCI 40623 11:36:08.947436 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:36:08.957987 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:36:08.968338 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:36:08.978752 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:36:08.989026 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:36:09.000284 tst sms:oc2g: Using 1 x modem (candidates: 2) 11:36:09.123111 tst sms:oc2g: Using 1 x modem (candidates: 2) 11:36:09.243516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:09.747186 run create_hlr_db(pid=16835): Launched 11:36:09.880494 bus /sierra_2: Setting Powered False 11:36:10.944803 run create_hlr_db(pid=16835): Terminated: ok {rc=0} 11:36:11.379007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16837): Launched 11:36:11.681294 run osmo-hlr_10.42.42.2(pid=16838): Launched 11:36:11.796112 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:12.329083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16840): Launched 11:36:12.631854 run osmo-stp_10.42.42.5(pid=16841): Launched 11:36:12.747253 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:13.294217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16843): Launched 11:36:13.598804 run osmo-msc_10.42.42.6(pid=16844): Launched 11:36:13.767607 run osmo-stp_10.42.42.5(pid=16841): ERR: Terminated: ERROR {rc=1} [trial-2404↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16841)] 11:36:13.895640 run osmo-stp_10.42.42.5(pid=16841): stdout: | (launched: 2022-12-14_11:36:12.575739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:14.023675 run osmo-stp_10.42.42.5(pid=16841): stderr: | [0;m[38;5;43m20221214113612743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113612743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113612743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113612744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113612744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113612744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113612744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:14.149866 run osmo-stp_10.42.42.5(pid=16841): stdout: | (launched: 2022-12-14_11:36:12.575739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:14.270202 run osmo-stp_10.42.42.5(pid=16841): stderr: | [0;m[38;5;43m20221214113612743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113612743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113612743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113612744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113612744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113612744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113612744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:14.414402 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=16841): Process ended prematurely: osmo-stp_10.42.42.5(pid=16841) [trial-2404↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16841)] [trial-2404↪sms:oc2g↪mo_mt_sms.py:16] 11:36:14.422762 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 11:36:14.448669 run osmo-hlr_10.42.42.2(pid=16838): ERR: Terminated: ERROR {rc=237} [trial-2404↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16838)] 11:36:14.498043 run osmo-hlr_10.42.42.2(pid=16838): stdout: | (launched: 2022-12-14_11:36:11.624873) 11:36:14.548224 run osmo-hlr_10.42.42.2(pid=16838): stderr: | [0;m[1;31m20221214113611798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113611798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113611799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113611799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113611799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113611799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113611811 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113611820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113611820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113611820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:14.618499 run osmo-msc_10.42.42.6(pid=16844): ERR: Terminated: ERROR {rc=2} [trial-2404↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16844)] 11:36:14.666631 run osmo-msc_10.42.42.6(pid=16844): stdout: | (launched: 2022-12-14_11:36:13.542654) 11:36:14.716353 run osmo-msc_10.42.42.6(pid=16844): stderr: | [0;m[38;5;43m20221214113613810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113613810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efcafaa5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113613810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113613810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113613810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113613810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113613812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113613812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113613813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113613813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:14.766173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16837): Terminating (SIGTERM) 11:36:14.806183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16840): Terminating (SIGTERM) 11:36:14.846348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16843): Terminating (SIGTERM) 11:36:14.886761 --- ParallelTerminationStrategy: PID 16837 died... 11:36:14.906257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16837): Terminated: ok {rc=0} 11:36:14.950556 --- ParallelTerminationStrategy: PID 16840 died... 11:36:14.969573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16840): Terminated: ok {rc=0} 11:36:15.013798 --- ParallelTerminationStrategy: PID 16843 died... 11:36:15.032719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16843): Terminated: ok {rc=0} 11:36:15.119448 bus /sierra_3: Setting Powered False 11:36:16.224715 bus /sierra_3: Setting Powered False 11:36:17.351753 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_ussd:oc2g --------------------------------------------------------------------- 11:36:18.568315 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:18.572822 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 11:36:18.593124 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 11:36:18.599856 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 11:36:18.636294 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 11:36:18.657150 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 11:36:18.664204 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 11:36:19.188566 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 11:36:19.194471 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 11:36:19.206994 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 11:36:19.244525 tst assert_extension.py: using LAC 40623 11:36:19.372139 tst assert_extension.py: using RAC 78 11:36:19.499566 tst assert_extension.py: using CellId 40623 11:36:19.627225 tst assert_extension.py: using BVCI 40624 11:36:19.746751 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 11:36:19.863950 tst assert_extension.py:10: start nitb and bts... 11:36:20.067409 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:36:20.684356 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16849): Launched 11:36:20.985775 run osmo-nitb_10.42.42.2(pid=16850): Launched 11:36:21.153475 run osmo-nitb_10.42.42.2(pid=16850): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16850)] 11:36:21.290255 run osmo-nitb_10.42.42.2(pid=16850): stdout: | (launched: 2022-12-14_11:36:20.929590) 11:36:21.428075 run osmo-nitb_10.42.42.2(pid=16850): stderr: | (launched: 2022-12-14_11:36:20.974391) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:36:21.566651 run osmo-nitb_10.42.42.2(pid=16850): stdout: | (launched: 2022-12-14_11:36:20.929590) 11:36:21.698645 run osmo-nitb_10.42.42.2(pid=16850): stderr: | (launched: 2022-12-14_11:36:20.974391) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16850): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16850) [trial-2404↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16850)] 11:36:22.099985 tst osmo-nitb_10.42.42.2(pid=16850): stdout: | (launched: 2022-12-14_11:36:20.929590) 11:36:22.222157 tst osmo-nitb_10.42.42.2(pid=16850): stderr: | (launched: 2022-12-14_11:36:20.974391) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:36:22.366055 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=16850): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16850) [trial-2404↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16850)] [trial-2404↪nitb_ussd:oc2g↪assert_extension.py:12] 11:36:22.374592 tst assert_extension.py:12: Test FAILED (3.2 sec) 11:36:22.381555 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16849): Terminating (SIGTERM) 11:36:22.591549 --- ParallelTerminationStrategy: PID 16849 died... 11:36:22.612671 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16849): Terminated: ok {rc=0} 11:36:22.700762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 ussd:oc2g --------------------------------------------------------------------- 11:36:23.864446 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:23.868373 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 11:36:23.888739 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 11:36:23.916714 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 11:36:23.958357 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 11:36:23.981481 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 11:36:24.009665 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 11:36:24.526819 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 ussd:oc2g assert_extension.py ---------------------------------------------- 11:36:24.532632 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:36:24.543753 tst ussd:oc2g: Using 1 x bts (candidates: 1) 11:36:24.577300 tst assert_extension.py: using LAC 40624 11:36:24.699033 tst assert_extension.py: using RAC 79 11:36:24.815258 tst assert_extension.py: using CellId 40624 11:36:24.932660 tst assert_extension.py: using BVCI 40625 11:36:25.042174 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:36:25.052587 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:36:25.062976 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:36:25.073269 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:36:25.083588 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:36:25.095375 tst ussd:oc2g: Using 1 x modem (candidates: 1) 11:36:25.217148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:25.722330 run create_hlr_db(pid=16854): Launched 11:36:25.855924 bus /sierra_2: Setting Powered False 11:36:26.920436 run create_hlr_db(pid=16854): Terminated: ok {rc=0} 11:36:27.354732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16856): Launched 11:36:27.657405 run osmo-hlr_10.42.42.2(pid=16857): Launched 11:36:27.773414 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:28.302728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16859): Launched 11:36:28.605519 run osmo-stp_10.42.42.5(pid=16860): Launched 11:36:28.721479 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:29.267662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16862): Launched 11:36:29.570358 run osmo-msc_10.42.42.6(pid=16863): Launched 11:36:29.738732 run osmo-stp_10.42.42.5(pid=16860): ERR: Terminated: ERROR {rc=1} [trial-2404↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16860)] 11:36:29.867240 run osmo-stp_10.42.42.5(pid=16860): stdout: | (launched: 2022-12-14_11:36:28.549333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:29.995083 run osmo-stp_10.42.42.5(pid=16860): stderr: | [0;m[38;5;43m20221214113628717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113628717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113628717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113628718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113628718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113628718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113628718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:30.121125 run osmo-stp_10.42.42.5(pid=16860): stdout: | (launched: 2022-12-14_11:36:28.549333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:30.241491 run osmo-stp_10.42.42.5(pid=16860): stderr: | [0;m[38;5;43m20221214113628717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113628717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113628717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113628718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113628718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113628718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113628718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:30.385849 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=16860): Process ended prematurely: osmo-stp_10.42.42.5(pid=16860) [trial-2404↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16860)] [trial-2404↪ussd:oc2g↪assert_extension.py:17] 11:36:30.394342 tst assert_extension.py:17: Test FAILED (5.9 sec) 11:36:30.420638 run osmo-hlr_10.42.42.2(pid=16857): ERR: Terminated: ERROR {rc=237} [trial-2404↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16857)] 11:36:30.469235 run osmo-hlr_10.42.42.2(pid=16857): stdout: | (launched: 2022-12-14_11:36:27.601134) 11:36:30.518940 run osmo-hlr_10.42.42.2(pid=16857): stderr: | [0;m[1;31m20221214113627776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113627776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113627776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113627776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113627776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113627777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113627789 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113627797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113627798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113627798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:30.589240 run osmo-msc_10.42.42.6(pid=16863): ERR: Terminated: ERROR {rc=2} [trial-2404↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16863)] 11:36:30.637331 run osmo-msc_10.42.42.6(pid=16863): stdout: | (launched: 2022-12-14_11:36:29.514149) 11:36:30.687423 run osmo-msc_10.42.42.6(pid=16863): stderr: | [0;m[38;5;43m20221214113629780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113629781 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe6570e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113629781 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113629781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113629781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113629781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113629783 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113629783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113629783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113629783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:30.737950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16856): Terminating (SIGTERM) 11:36:30.778579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16859): Terminating (SIGTERM) 11:36:30.818985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16862): Terminating (SIGTERM) 11:36:30.888193 --- ParallelTerminationStrategy: PID 16856 died... 11:36:30.913521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16856): Terminated: ok {rc=0} 11:36:30.964919 --- ParallelTerminationStrategy: PID 16859 died... 11:36:30.985811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16859): Terminated: ok {rc=0} 11:36:31.034303 --- ParallelTerminationStrategy: PID 16862 died... 11:36:31.054716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16862): Terminated: ok {rc=0} 11:36:31.148831 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:36:32.352157 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:32.358576 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:36:32.379035 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:36:32.406883 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:36:32.459369 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:36:32.481435 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:36:32.509694 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:36:33.057625 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:36:33.113407 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:33.124875 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:36:33.183841 tst mo_mt_call.py: using LAC 40625 11:36:33.315320 tst mo_mt_call.py: using RAC 80 11:36:33.445328 tst mo_mt_call.py: using CellId 40625 11:36:33.574636 tst mo_mt_call.py: using BVCI 40626 11:36:33.696499 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:33.708191 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:33.719510 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:33.730791 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:33.742470 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:33.753868 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:36:33.872214 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:36:33.994791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:34.510291 run create_hlr_db(pid=16869): Launched 11:36:34.646067 bus /sierra_2: Setting Powered False 11:36:35.711641 run create_hlr_db(pid=16869): Terminated: ok {rc=0} 11:36:36.154679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16871): Launched 11:36:36.464596 run osmo-hlr_10.42.42.2(pid=16872): Launched 11:36:36.582579 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:37.126340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16874): Launched 11:36:37.437122 run osmo-stp_10.42.42.5(pid=16875): Launched 11:36:37.554788 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:38.112412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16877): Launched 11:36:38.421022 run osmo-msc_10.42.42.6(pid=16878): Launched 11:36:38.594073 run osmo-stp_10.42.42.5(pid=16875): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16875)] 11:36:38.725451 run osmo-stp_10.42.42.5(pid=16875): stdout: | (launched: 2022-12-14_11:36:37.378694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:38.855766 run osmo-stp_10.42.42.5(pid=16875): stderr: | [0;m[38;5;43m20221214113637549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113637549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113637549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113637550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113637550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113637550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113637550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:38.984365 run osmo-stp_10.42.42.5(pid=16875): stdout: | (launched: 2022-12-14_11:36:37.378694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:39.106610 run osmo-stp_10.42.42.5(pid=16875): stderr: | [0;m[38;5;43m20221214113637549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113637549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113637549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113637550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113637550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113637550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113637550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:39.253457 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16875): Process ended prematurely: osmo-stp_10.42.42.5(pid=16875) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16875)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:36:39.262309 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:36:39.288896 run osmo-hlr_10.42.42.2(pid=16872): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16872)] 11:36:39.337809 run osmo-hlr_10.42.42.2(pid=16872): stdout: | (launched: 2022-12-14_11:36:36.406775) 11:36:39.388227 run osmo-hlr_10.42.42.2(pid=16872): stderr: | [0;m[1;31m20221214113636582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113636582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113636582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113636582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113636582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113636582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113636594 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113636602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113636602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113636602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:39.458533 run osmo-msc_10.42.42.6(pid=16878): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16878)] 11:36:39.506624 run osmo-msc_10.42.42.6(pid=16878): stdout: | (launched: 2022-12-14_11:36:38.363762) 11:36:39.556559 run osmo-msc_10.42.42.6(pid=16878): stderr: | [0;m[38;5;43m20221214113638632 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113638632 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1ebe154c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113638632 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113638632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113638632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113638632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113638634 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113638634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113638635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113638635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:39.606930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16871): Terminating (SIGTERM) 11:36:39.647403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16874): Terminating (SIGTERM) 11:36:39.687722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16877): Terminating (SIGTERM) 11:36:39.728449 --- ParallelTerminationStrategy: PID 16871 died... 11:36:39.748192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16871): Terminated: ok {rc=0} 11:36:39.792735 --- ParallelTerminationStrategy: PID 16874 died... 11:36:39.811784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16874): Terminated: ok {rc=0} 11:36:39.856130 --- ParallelTerminationStrategy: PID 16877 died... 11:36:39.875208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16877): Terminated: ok {rc=0} 11:36:39.962556 bus /sierra_3: Setting Powered False 11:36:41.063627 bus /sierra_3: Setting Powered False 11:36:42.178824 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:36:43.329561 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:43.341839 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:36:43.400054 tst mo_mt_call_osmux.py: using LAC 40626 11:36:43.529551 tst mo_mt_call_osmux.py: using RAC 81 11:36:43.658591 tst mo_mt_call_osmux.py: using CellId 40626 11:36:43.788830 tst mo_mt_call_osmux.py: using BVCI 40627 11:36:43.901539 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:43.912667 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:43.923798 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:43.934805 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:43.946199 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:43.957427 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:36:44.078427 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:36:44.197560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:44.675235 run create_hlr_db(pid=16880): Launched 11:36:44.792321 bus /sierra_2: Setting Powered False 11:36:45.854460 run create_hlr_db(pid=16880): Terminated: ok {rc=0} 11:36:46.306057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16882): Launched 11:36:46.636779 run osmo-hlr_10.42.42.2(pid=16883): Launched 11:36:46.763528 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:47.338622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16885): Launched 11:36:47.670477 run osmo-stp_10.42.42.5(pid=16886): Launched 11:36:47.797115 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:48.393205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16888): Launched 11:36:48.725606 run osmo-msc_10.42.42.6(pid=16889): Launched 11:36:48.908486 run osmo-stp_10.42.42.5(pid=16886): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16886)] 11:36:49.046986 run osmo-stp_10.42.42.5(pid=16886): stdout: | (launched: 2022-12-14_11:36:47.609370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:49.186909 run osmo-stp_10.42.42.5(pid=16886): stderr: | [0;m[38;5;43m20221214113647800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113647800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113647801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113647801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113647802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113647802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113647802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:49.324603 run osmo-stp_10.42.42.5(pid=16886): stdout: | (launched: 2022-12-14_11:36:47.609370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:49.455701 run osmo-stp_10.42.42.5(pid=16886): stderr: | [0;m[38;5;43m20221214113647800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113647800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113647801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113647801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113647802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113647802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113647802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:49.613689 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16886): Process ended prematurely: osmo-stp_10.42.42.5(pid=16886) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16886)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:36:49.623493 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:36:49.651747 run osmo-hlr_10.42.42.2(pid=16883): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16883)] 11:36:49.702438 run osmo-hlr_10.42.42.2(pid=16883): stdout: | (launched: 2022-12-14_11:36:46.576022) 11:36:49.754462 run osmo-hlr_10.42.42.2(pid=16883): stderr: | [0;m[1;31m20221214113646773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113646773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113646773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113646773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113646773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113646773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113646786 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113646795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113646795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113646795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:49.826569 run osmo-msc_10.42.42.6(pid=16889): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16889)] 11:36:49.876391 run osmo-msc_10.42.42.6(pid=16889): stdout: | (launched: 2022-12-14_11:36:48.664160) 11:36:49.928128 run osmo-msc_10.42.42.6(pid=16889): stderr: | [0;m[38;5;43m20221214113648983 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113648983 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e794e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113648983 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113648983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113648984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113648984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113648986 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113648986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113648986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113648986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:49.980266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16882): Terminating (SIGTERM) 11:36:50.022298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16885): Terminating (SIGTERM) 11:36:50.064331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16888): Terminating (SIGTERM) 11:36:50.106500 --- ParallelTerminationStrategy: PID 16882 died... 11:36:50.126371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16882): Terminated: ok {rc=0} 11:36:50.172340 --- ParallelTerminationStrategy: PID 16885 died... 11:36:50.191942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16885): Terminated: ok {rc=0} 11:36:50.237907 --- ParallelTerminationStrategy: PID 16888 died... 11:36:50.257557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16888): Terminated: ok {rc=0} 11:36:50.346023 bus /sierra_3: Setting Powered False 11:36:51.442178 bus /sierra_3: Setting Powered False 11:36:52.557809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:36:53.796875 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:53.804558 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:36:53.826127 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:36:53.854346 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:36:53.907166 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:36:53.928897 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:36:53.956198 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:36:54.505079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:36:54.555260 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:54.566541 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:36:54.626426 tst mo_mt_call.py: using LAC 40627 11:36:54.749363 tst mo_mt_call.py: using RAC 82 11:36:54.870551 tst mo_mt_call.py: using CellId 40627 11:36:54.990949 tst mo_mt_call.py: using BVCI 40628 11:36:55.103915 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:55.115079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:55.126528 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:55.137505 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:55.148629 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:55.159923 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:36:55.283166 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:36:55.404058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:55.919730 run create_hlr_db(pid=16894): Launched 11:36:56.055134 bus /sierra_2: Setting Powered False 11:36:57.120491 run create_hlr_db(pid=16894): Terminated: ok {rc=0} 11:36:57.564713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16896): Launched 11:36:57.873256 run osmo-hlr_10.42.42.2(pid=16897): Launched 11:36:57.989976 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:58.536166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16899): Launched 11:36:58.869587 run osmo-stp_10.42.42.5(pid=16900): Launched 11:36:58.996052 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:59.595925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16902): Launched 11:36:59.930362 run osmo-msc_10.42.42.6(pid=16903): Launched 11:37:00.115885 run osmo-stp_10.42.42.5(pid=16900): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16900)] 11:37:00.255425 run osmo-stp_10.42.42.5(pid=16900): stdout: | (launched: 2022-12-14_11:36:58.808765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:00.395982 run osmo-stp_10.42.42.5(pid=16900): stderr: | [0;m[38;5;43m20221214113659000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113659001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113659001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113659001 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113659002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113659002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113659002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:00.534761 run osmo-stp_10.42.42.5(pid=16900): stdout: | (launched: 2022-12-14_11:36:58.808765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:00.667172 run osmo-stp_10.42.42.5(pid=16900): stderr: | [0;m[38;5;43m20221214113659000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113659001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113659001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113659001 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113659002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113659002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113659002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:00.825785 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16900): Process ended prematurely: osmo-stp_10.42.42.5(pid=16900) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16900)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:37:00.844842 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:37:00.891253 run osmo-hlr_10.42.42.2(pid=16897): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16897)] 11:37:00.953807 run osmo-hlr_10.42.42.2(pid=16897): stdout: | (launched: 2022-12-14_11:36:57.816142) 11:37:01.006976 run osmo-hlr_10.42.42.2(pid=16897): stderr: | [0;m[1;31m20221214113657990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113657990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113657990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113657990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113657990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113657990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113658003 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113658014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113658014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113658014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:01.081419 run osmo-msc_10.42.42.6(pid=16903): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16903)] 11:37:01.132742 run osmo-msc_10.42.42.6(pid=16903): stdout: | (launched: 2022-12-14_11:36:59.869255) 11:37:01.185823 run osmo-msc_10.42.42.6(pid=16903): stderr: | [0;m[38;5;43m20221214113700190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113700190 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f40995fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113700190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113700190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113700190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113700190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113700192 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113700192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113700193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113700193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:01.239326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16896): Terminating (SIGTERM) 11:37:01.282989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16899): Terminating (SIGTERM) 11:37:01.328128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16902): Terminating (SIGTERM) 11:37:01.373339 --- ParallelTerminationStrategy: PID 16896 died... 11:37:01.394035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16896): Terminated: ok {rc=0} 11:37:01.441569 --- ParallelTerminationStrategy: PID 16899 died... 11:37:01.462195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16899): Terminated: ok {rc=0} 11:37:01.509806 --- ParallelTerminationStrategy: PID 16902 died... 11:37:01.530353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16902): Terminated: ok {rc=0} 11:37:01.622522 bus /sierra_3: Setting Powered False 11:37:02.724393 bus /sierra_3: Setting Powered False 11:37:03.843109 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:37:04.994026 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:05.006425 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:37:05.065465 tst mo_mt_call_osmux.py: using LAC 40628 11:37:05.196775 tst mo_mt_call_osmux.py: using RAC 83 11:37:05.325766 tst mo_mt_call_osmux.py: using CellId 40628 11:37:05.461401 tst mo_mt_call_osmux.py: using BVCI 40629 11:37:05.583088 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:05.594701 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:05.606078 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:05.617615 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:05.629132 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:05.640511 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:37:05.759773 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:37:05.885591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:06.401886 run create_hlr_db(pid=16905): Launched 11:37:06.535849 bus /sierra_2: Setting Powered False 11:37:07.601822 run create_hlr_db(pid=16905): Terminated: ok {rc=0} 11:37:08.066242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16907): Launched 11:37:08.398335 run osmo-hlr_10.42.42.2(pid=16908): Launched 11:37:08.525225 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:09.103004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16910): Launched 11:37:09.435716 run osmo-stp_10.42.42.5(pid=16911): Launched 11:37:09.562294 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:10.160841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16913): Launched 11:37:10.494929 run osmo-msc_10.42.42.6(pid=16914): Launched 11:37:10.678413 run osmo-stp_10.42.42.5(pid=16911): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16911)] 11:37:10.819628 run osmo-stp_10.42.42.5(pid=16911): stdout: | (launched: 2022-12-14_11:37:09.374853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:10.959326 run osmo-stp_10.42.42.5(pid=16911): stderr: | [0;m[38;5;43m20221214113709565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113709565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113709566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113709566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113709566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113709566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113709567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:11.096804 run osmo-stp_10.42.42.5(pid=16911): stdout: | (launched: 2022-12-14_11:37:09.374853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:11.227723 run osmo-stp_10.42.42.5(pid=16911): stderr: | [0;m[38;5;43m20221214113709565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113709565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113709566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113709566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113709566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113709566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113709567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:11.384614 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16911): Process ended prematurely: osmo-stp_10.42.42.5(pid=16911) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16911)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:37:11.394304 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:37:11.422119 run osmo-hlr_10.42.42.2(pid=16908): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16908)] 11:37:11.472287 run osmo-hlr_10.42.42.2(pid=16908): stdout: | (launched: 2022-12-14_11:37:08.337547) 11:37:11.523818 run osmo-hlr_10.42.42.2(pid=16908): stderr: | [0;m[1;31m20221214113708533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113708533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113708533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113708533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113708534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113708534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113708546 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113708555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113708555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113708555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:11.595976 run osmo-msc_10.42.42.6(pid=16914): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16914)] 11:37:11.645817 run osmo-msc_10.42.42.6(pid=16914): stdout: | (launched: 2022-12-14_11:37:10.433441) 11:37:11.697976 run osmo-msc_10.42.42.6(pid=16914): stderr: | [0;m[38;5;43m20221214113710753 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113710753 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc035b87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113710753 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113710753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113710754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113710754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113710755 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113710756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113710756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113710756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:11.750161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16907): Terminating (SIGTERM) 11:37:11.792200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16910): Terminating (SIGTERM) 11:37:11.834382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16913): Terminating (SIGTERM) 11:37:11.876727 --- ParallelTerminationStrategy: PID 16907 died... 11:37:11.897292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16907): Terminated: ok {rc=0} 11:37:11.943559 --- ParallelTerminationStrategy: PID 16910 died... 11:37:11.963301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16910): Terminated: ok {rc=0} 11:37:12.009665 --- ParallelTerminationStrategy: PID 16913 died... 11:37:12.029305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16913): Terminated: ok {rc=0} 11:37:12.117007 bus /sierra_3: Setting Powered False 11:37:13.214236 bus /sierra_3: Setting Powered False 11:37:14.331437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:37:15.564352 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:15.570800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:37:15.591246 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:37:15.619067 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:37:15.671051 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:37:15.692540 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:37:15.720696 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:37:16.288207 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:37:16.344245 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:16.356318 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:37:16.414147 tst mo_mt_call.py: using LAC 40629 11:37:16.564003 tst mo_mt_call.py: using RAC 84 11:37:16.691475 tst mo_mt_call.py: using CellId 40629 11:37:16.855679 tst mo_mt_call.py: using BVCI 40630 11:37:16.978203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:16.990612 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:17.002814 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:17.014911 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:17.027819 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:17.042029 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:37:17.168736 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:37:17.290590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:17.770262 run create_hlr_db(pid=16919): Launched 11:37:17.891070 bus /sierra_2: Setting Powered False 11:37:18.952695 run create_hlr_db(pid=16919): Terminated: ok {rc=0} 11:37:19.384078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16921): Launched 11:37:19.693651 run osmo-hlr_10.42.42.2(pid=16922): Launched 11:37:19.811025 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:20.339345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16924): Launched 11:37:20.649977 run osmo-stp_10.42.42.5(pid=16925): Launched 11:37:20.769486 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:21.327267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16927): Launched 11:37:21.637937 run osmo-msc_10.42.42.6(pid=16928): Launched 11:37:21.812033 run osmo-stp_10.42.42.5(pid=16925): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16925)] 11:37:21.943478 run osmo-stp_10.42.42.5(pid=16925): stdout: | (launched: 2022-12-14_11:37:20.592286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:22.074251 run osmo-stp_10.42.42.5(pid=16925): stderr: | [0;m[38;5;43m20221214113720762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113720762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113720762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113720762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113720763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113720763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113720763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:22.203224 run osmo-stp_10.42.42.5(pid=16925): stdout: | (launched: 2022-12-14_11:37:20.592286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:22.325732 run osmo-stp_10.42.42.5(pid=16925): stderr: | [0;m[38;5;43m20221214113720762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113720762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113720762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113720762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113720763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113720763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113720763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:22.472611 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16925): Process ended prematurely: osmo-stp_10.42.42.5(pid=16925) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16925)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:37:22.481769 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:37:22.508611 run osmo-hlr_10.42.42.2(pid=16922): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16922)] 11:37:22.558114 run osmo-hlr_10.42.42.2(pid=16922): stdout: | (launched: 2022-12-14_11:37:19.636442) 11:37:22.607851 run osmo-hlr_10.42.42.2(pid=16922): stderr: | [0;m[1;31m20221214113719811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113719811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113719811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113719811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113719811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113719811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113719823 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113719831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113719832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113719832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:22.677741 run osmo-msc_10.42.42.6(pid=16928): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16928)] 11:37:22.725384 run osmo-msc_10.42.42.6(pid=16928): stdout: | (launched: 2022-12-14_11:37:21.580391) 11:37:22.774847 run osmo-msc_10.42.42.6(pid=16928): stderr: | [0;m[38;5;43m20221214113721848 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113721849 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa865cc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113721849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113721849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113721849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113721849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113721851 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113721851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113721851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113721851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:22.825454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16921): Terminating (SIGTERM) 11:37:22.865642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16924): Terminating (SIGTERM) 11:37:22.905813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16927): Terminating (SIGTERM) 11:37:22.946144 --- ParallelTerminationStrategy: PID 16921 died... 11:37:22.965885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16921): Terminated: ok {rc=0} 11:37:23.010357 --- ParallelTerminationStrategy: PID 16924 died... 11:37:23.029407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16924): Terminated: ok {rc=0} 11:37:23.074332 --- ParallelTerminationStrategy: PID 16927 died... 11:37:23.093290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16927): Terminated: ok {rc=0} 11:37:23.177139 bus /sierra_3: Setting Powered False 11:37:24.275662 bus /sierra_3: Setting Powered False 11:37:25.392791 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:37:26.544630 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:26.556888 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:37:26.614890 tst mo_mt_call_osmux.py: using LAC 40630 11:37:26.744818 tst mo_mt_call_osmux.py: using RAC 85 11:37:26.874542 tst mo_mt_call_osmux.py: using CellId 40630 11:37:27.004913 tst mo_mt_call_osmux.py: using BVCI 40631 11:37:27.125363 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:27.137167 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:27.148643 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:27.160169 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:27.171558 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:27.183150 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:37:27.305768 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:37:27.425359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:27.906442 run create_hlr_db(pid=16930): Launched 11:37:28.028001 bus /sierra_2: Setting Powered False 11:37:29.090379 run create_hlr_db(pid=16930): Terminated: ok {rc=0} 11:37:29.544374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16932): Launched 11:37:29.879876 run osmo-hlr_10.42.42.2(pid=16933): Launched 11:37:30.006150 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:30.581149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16935): Launched 11:37:30.937811 run osmo-stp_10.42.42.5(pid=16936): Launched 11:37:31.078160 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:31.818334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16938): Launched 11:37:32.178252 run osmo-msc_10.42.42.6(pid=16939): Launched 11:37:32.457069 run osmo-stp_10.42.42.5(pid=16936): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16936)] 11:37:32.597954 run osmo-stp_10.42.42.5(pid=16936): stdout: | (launched: 2022-12-14_11:37:30.858543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:32.736290 run osmo-stp_10.42.42.5(pid=16936): stderr: | [0;m[38;5;43m20221214113731240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113731240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113731242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113731245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113731247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113731248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113731248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:32.874260 run osmo-stp_10.42.42.5(pid=16936): stdout: | (launched: 2022-12-14_11:37:30.858543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:33.006215 run osmo-stp_10.42.42.5(pid=16936): stderr: | [0;m[38;5;43m20221214113731240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113731240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113731242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113731245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113731247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113731248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113731248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:33.163934 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16936): Process ended prematurely: osmo-stp_10.42.42.5(pid=16936) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16936)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:37:33.173715 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 11:37:33.202187 run osmo-hlr_10.42.42.2(pid=16933): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16933)] 11:37:33.253161 run osmo-hlr_10.42.42.2(pid=16933): stdout: | (launched: 2022-12-14_11:37:29.818751) 11:37:33.305280 run osmo-hlr_10.42.42.2(pid=16933): stderr: | [0;m[1;31m20221214113730016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113730016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113730016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113730016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113730016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113730016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113730028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113730037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113730038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113730038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:33.377727 run osmo-msc_10.42.42.6(pid=16939): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16939)] 11:37:33.427898 run osmo-msc_10.42.42.6(pid=16939): stdout: | (launched: 2022-12-14_11:37:32.115814) 11:37:33.479858 run osmo-msc_10.42.42.6(pid=16939): stderr: | [0;m[38;5;43m20221214113732506 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113732506 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f34e4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113732506 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113732506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113732507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113732507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113732508 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113732509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113732509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113732509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:33.532313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16932): Terminating (SIGTERM) 11:37:33.574336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16935): Terminating (SIGTERM) 11:37:33.616344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16938): Terminating (SIGTERM) 11:37:33.658826 --- ParallelTerminationStrategy: PID 16932 died... 11:37:33.679361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16932): Terminated: ok {rc=0} 11:37:33.726580 --- ParallelTerminationStrategy: PID 16935 died... 11:37:33.746508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16935): Terminated: ok {rc=0} 11:37:33.793235 --- ParallelTerminationStrategy: PID 16938 died... 11:37:33.812848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16938): Terminated: ok {rc=0} 11:37:33.902123 bus /sierra_3: Setting Powered False 11:37:35.001704 bus /sierra_3: Setting Powered False 11:37:36.118420 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:37:37.358106 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:37.365256 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:37:37.386441 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:37:37.414219 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:37:37.466939 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:37:37.488234 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:37:37.516291 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:37:38.067118 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:37:38.121498 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:38.133185 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:37:38.196425 tst mo_mt_call.py: using LAC 40631 11:37:38.326320 tst mo_mt_call.py: using RAC 86 11:37:38.455588 tst mo_mt_call.py: using CellId 40631 11:37:38.583422 tst mo_mt_call.py: using BVCI 40632 11:37:38.697073 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:38.708345 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:38.719391 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:38.730547 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:38.741962 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:38.753678 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:38.876525 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:38.999015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:39.479669 run create_hlr_db(pid=16944): Launched 11:37:39.597817 bus /sierra_2: Setting Powered False 11:37:40.660030 run create_hlr_db(pid=16944): Terminated: ok {rc=0} 11:37:41.092816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16946): Launched 11:37:41.402921 run osmo-hlr_10.42.42.2(pid=16947): Launched 11:37:41.521235 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:42.053420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16949): Launched 11:37:42.362740 run osmo-stp_10.42.42.5(pid=16950): Launched 11:37:42.480489 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:43.038773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16952): Launched 11:37:43.348319 run osmo-msc_10.42.42.6(pid=16953): Launched 11:37:43.521960 run osmo-stp_10.42.42.5(pid=16950): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16950)] 11:37:43.652299 run osmo-stp_10.42.42.5(pid=16950): stdout: | (launched: 2022-12-14_11:37:42.305619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:43.783256 run osmo-stp_10.42.42.5(pid=16950): stderr: | [0;m[38;5;43m20221214113742474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113742474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113742474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113742475 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113742475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113742475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113742475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:43.912004 run osmo-stp_10.42.42.5(pid=16950): stdout: | (launched: 2022-12-14_11:37:42.305619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:44.035099 run osmo-stp_10.42.42.5(pid=16950): stderr: | [0;m[38;5;43m20221214113742474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113742474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113742474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113742475 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113742475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113742475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113742475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:44.181974 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16950): Process ended prematurely: osmo-stp_10.42.42.5(pid=16950) [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16950)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:37:44.191026 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:37:44.217859 run osmo-hlr_10.42.42.2(pid=16947): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16947)] 11:37:44.266937 run osmo-hlr_10.42.42.2(pid=16947): stdout: | (launched: 2022-12-14_11:37:41.345447) 11:37:44.317090 run osmo-hlr_10.42.42.2(pid=16947): stderr: | [0;m[1;31m20221214113741519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113741519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113741519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113741519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113741519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113741519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113741531 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113741539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113741539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113741539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:44.387376 run osmo-msc_10.42.42.6(pid=16953): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16953)] 11:37:44.435079 run osmo-msc_10.42.42.6(pid=16953): stdout: | (launched: 2022-12-14_11:37:43.290832) 11:37:44.485193 run osmo-msc_10.42.42.6(pid=16953): stderr: | [0;m[38;5;43m20221214113743559 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113743559 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6648043c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113743559 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113743559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113743559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113743560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113743561 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113743562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113743562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113743562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:44.535710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16946): Terminating (SIGTERM) 11:37:44.576397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16949): Terminating (SIGTERM) 11:37:44.617203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16952): Terminating (SIGTERM) 11:37:44.658785 --- ParallelTerminationStrategy: PID 16946 died... 11:37:44.678650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16946): Terminated: ok {rc=0} 11:37:44.723749 --- ParallelTerminationStrategy: PID 16949 died... 11:37:44.743092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16949): Terminated: ok {rc=0} 11:37:44.787554 --- ParallelTerminationStrategy: PID 16952 died... 11:37:44.806819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16952): Terminated: ok {rc=0} 11:37:44.892373 bus /sierra_3: Setting Powered False 11:37:45.990218 bus /sierra_3: Setting Powered False 11:37:47.118278 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:37:48.264540 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:48.276371 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:37:48.333459 tst mo_mt_call_osmux.py: using LAC 40632 11:37:48.464330 tst mo_mt_call_osmux.py: using RAC 87 11:37:48.595959 tst mo_mt_call_osmux.py: using CellId 40632 11:37:48.725789 tst mo_mt_call_osmux.py: using BVCI 40633 11:37:48.847752 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:48.859597 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:48.871183 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:48.882685 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:48.894126 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:48.905595 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:49.025356 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:49.144140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:49.624349 run create_hlr_db(pid=16955): Launched 11:37:49.743897 bus /sierra_2: Setting Powered False 11:37:50.806136 run create_hlr_db(pid=16955): Terminated: ok {rc=0} 11:37:51.260152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16957): Launched 11:37:51.595964 run osmo-hlr_10.42.42.2(pid=16958): Launched 11:37:51.721524 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:52.293936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16960): Launched 11:37:52.626943 run osmo-stp_10.42.42.5(pid=16961): Launched 11:37:52.754087 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:53.354275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16963): Launched 11:37:53.685887 run osmo-msc_10.42.42.6(pid=16964): Launched 11:37:53.871002 run osmo-stp_10.42.42.5(pid=16961): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16961)] 11:37:54.010809 run osmo-stp_10.42.42.5(pid=16961): stdout: | (launched: 2022-12-14_11:37:52.566126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:54.150623 run osmo-stp_10.42.42.5(pid=16961): stderr: | [0;m[38;5;43m20221214113752757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113752757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113752758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113752758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113752758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113752759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113752759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:54.288870 run osmo-stp_10.42.42.5(pid=16961): stdout: | (launched: 2022-12-14_11:37:52.566126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:54.420347 run osmo-stp_10.42.42.5(pid=16961): stderr: | [0;m[38;5;43m20221214113752757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113752757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113752758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113752758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113752758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113752759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113752759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:54.577439 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16961): Process ended prematurely: osmo-stp_10.42.42.5(pid=16961) [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16961)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:37:54.587365 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:37:54.615472 run osmo-hlr_10.42.42.2(pid=16958): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16958)] 11:37:54.666118 run osmo-hlr_10.42.42.2(pid=16958): stdout: | (launched: 2022-12-14_11:37:51.534695) 11:37:54.718310 run osmo-hlr_10.42.42.2(pid=16958): stderr: | [0;m[1;31m20221214113751730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113751730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113751730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113751730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113751731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113751731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113751746 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113751757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113751757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113751757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:54.791488 run osmo-msc_10.42.42.6(pid=16964): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16964)] 11:37:54.841587 run osmo-msc_10.42.42.6(pid=16964): stdout: | (launched: 2022-12-14_11:37:53.624676) 11:37:54.893516 run osmo-msc_10.42.42.6(pid=16964): stderr: | [0;m[38;5;43m20221214113753947 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113753947 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9fcbfd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113753947 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113753947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113753948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113753948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113753950 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113753950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113753950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113753950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:54.945591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16957): Terminating (SIGTERM) 11:37:54.987656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16960): Terminating (SIGTERM) 11:37:55.029589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16963): Terminating (SIGTERM) 11:37:55.072479 --- ParallelTerminationStrategy: PID 16957 died... 11:37:55.092782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16957): Terminated: ok {rc=0} 11:37:55.139293 --- ParallelTerminationStrategy: PID 16960 died... 11:37:55.159150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16960): Terminated: ok {rc=0} 11:37:55.205499 --- ParallelTerminationStrategy: PID 16963 died... 11:37:55.225425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16963): Terminated: ok {rc=0} 11:37:55.314706 bus /sierra_3: Setting Powered False 11:37:56.414919 bus /sierra_3: Setting Powered False 11:37:57.532354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:37:58.771162 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:58.778057 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:37:58.799321 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:37:58.826766 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:37:58.878299 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:37:58.899918 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:37:58.927244 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:37:59.480316 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:37:59.533274 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:37:59.544727 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:37:59.606427 tst mo_mt_call.py: using LAC 40633 11:37:59.734957 tst mo_mt_call.py: using RAC 88 11:37:59.867313 tst mo_mt_call.py: using CellId 40633 11:37:59.997379 tst mo_mt_call.py: using BVCI 40634 11:38:00.118279 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:00.129892 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:00.141247 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:00.152541 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:00.163906 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:00.175251 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:38:00.295867 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:38:00.417153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:00.941184 run create_hlr_db(pid=16972): Launched 11:38:01.107861 bus /sierra_2: Setting Powered False 11:38:02.173260 run create_hlr_db(pid=16972): Terminated: ok {rc=0} 11:38:02.619785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16974): Launched 11:38:02.930953 run osmo-hlr_10.42.42.2(pid=16975): Launched 11:38:03.050923 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:03.597154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16977): Launched 11:38:03.906413 run osmo-stp_10.42.42.5(pid=16978): Launched 11:38:04.029524 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:04.587911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16980): Launched 11:38:04.898090 run osmo-msc_10.42.42.6(pid=16981): Launched 11:38:05.072904 run osmo-stp_10.42.42.5(pid=16978): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16978)] 11:38:05.204461 run osmo-stp_10.42.42.5(pid=16978): stdout: | (launched: 2022-12-14_11:38:03.848829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:05.335539 run osmo-stp_10.42.42.5(pid=16978): stderr: | [0;m[38;5;43m20221214113804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113804022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:05.465166 run osmo-stp_10.42.42.5(pid=16978): stdout: | (launched: 2022-12-14_11:38:03.848829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:05.588008 run osmo-stp_10.42.42.5(pid=16978): stderr: | [0;m[38;5;43m20221214113804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113804022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:05.735558 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16978): Process ended prematurely: osmo-stp_10.42.42.5(pid=16978) [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16978)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:38:05.744572 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:38:05.771330 run osmo-hlr_10.42.42.2(pid=16975): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16975)] 11:38:05.819917 run osmo-hlr_10.42.42.2(pid=16975): stdout: | (launched: 2022-12-14_11:38:02.873466) 11:38:05.869748 run osmo-hlr_10.42.42.2(pid=16975): stderr: | [0;m[1;31m20221214113803045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113803045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113803045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113803045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113803045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113803045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113803058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113803068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113803068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113803068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:05.939225 run osmo-msc_10.42.42.6(pid=16981): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16981)] 11:38:05.986875 run osmo-msc_10.42.42.6(pid=16981): stdout: | (launched: 2022-12-14_11:38:04.840445) 11:38:06.036176 run osmo-msc_10.42.42.6(pid=16981): stderr: | [0;m[38;5;43m20221214113805108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113805108 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0468685c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113805108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113805108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113805109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113805109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113805111 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113805111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113805111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113805112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:06.085768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16974): Terminating (SIGTERM) 11:38:06.126098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16977): Terminating (SIGTERM) 11:38:06.166049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16980): Terminating (SIGTERM) 11:38:06.206314 --- ParallelTerminationStrategy: PID 16974 died... 11:38:06.225850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16974): Terminated: ok {rc=0} 11:38:06.270139 --- ParallelTerminationStrategy: PID 16977 died... 11:38:06.289075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16977): Terminated: ok {rc=0} 11:38:06.333407 --- ParallelTerminationStrategy: PID 16980 died... 11:38:06.352283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16980): Terminated: ok {rc=0} 11:38:06.436750 bus /sierra_3: Setting Powered False 11:38:07.535246 bus /sierra_3: Setting Powered False 11:38:08.652412 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:38:09.803040 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:09.815661 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:38:09.873998 tst mo_mt_call_osmux.py: using LAC 40634 11:38:10.005525 tst mo_mt_call_osmux.py: using RAC 89 11:38:10.135019 tst mo_mt_call_osmux.py: using CellId 40634 11:38:10.267592 tst mo_mt_call_osmux.py: using BVCI 40635 11:38:10.387980 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:10.399650 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:10.411003 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:10.422377 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:10.433749 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:10.445201 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:38:10.566960 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:38:10.685467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:11.167288 run create_hlr_db(pid=16983): Launched 11:38:11.287227 bus /sierra_2: Setting Powered False 11:38:12.348245 run create_hlr_db(pid=16983): Terminated: ok {rc=0} 11:38:12.802477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16985): Launched 11:38:13.136433 run osmo-hlr_10.42.42.2(pid=16986): Launched 11:38:13.263641 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:13.843571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16988): Launched 11:38:14.176473 run osmo-stp_10.42.42.5(pid=16989): Launched 11:38:14.304372 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:14.906551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16991): Launched 11:38:15.241070 run osmo-msc_10.42.42.6(pid=16992): Launched 11:38:15.425248 run osmo-stp_10.42.42.5(pid=16989): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16989)] 11:38:15.564659 run osmo-stp_10.42.42.5(pid=16989): stdout: | (launched: 2022-12-14_11:38:14.114879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:15.704179 run osmo-stp_10.42.42.5(pid=16989): stderr: | [0;m[38;5;43m20221214113814306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113814306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113814306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113814307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113814307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113814307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113814307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:15.843530 run osmo-stp_10.42.42.5(pid=16989): stdout: | (launched: 2022-12-14_11:38:14.114879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:15.982971 run osmo-stp_10.42.42.5(pid=16989): stderr: | [0;m[38;5;43m20221214113814306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113814306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113814306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113814307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113814307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113814307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113814307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:16.143856 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16989): Process ended prematurely: osmo-stp_10.42.42.5(pid=16989) [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16989)] [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:38:16.154191 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:38:16.184039 run osmo-hlr_10.42.42.2(pid=16986): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16986)] 11:38:16.236088 run osmo-hlr_10.42.42.2(pid=16986): stdout: | (launched: 2022-12-14_11:38:13.075378) 11:38:16.289641 run osmo-hlr_10.42.42.2(pid=16986): stderr: | [0;m[1;31m20221214113813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113813283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113813292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113813292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113813292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:16.364311 run osmo-msc_10.42.42.6(pid=16992): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16992)] 11:38:16.417161 run osmo-msc_10.42.42.6(pid=16992): stdout: | (launched: 2022-12-14_11:38:15.179818) 11:38:16.470402 run osmo-msc_10.42.42.6(pid=16992): stderr: | [0;m[38;5;43m20221214113815499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113815499 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e2c700c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113815499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113815499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113815499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113815500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113815501 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113815502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113815502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113815502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:16.524068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16985): Terminating (SIGTERM) 11:38:16.567698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16988): Terminating (SIGTERM) 11:38:16.610663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16991): Terminating (SIGTERM) 11:38:16.653848 --- ParallelTerminationStrategy: PID 16985 died... 11:38:16.674391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16985): Terminated: ok {rc=0} 11:38:16.721741 --- ParallelTerminationStrategy: PID 16988 died... 11:38:16.742373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16988): Terminated: ok {rc=0} 11:38:16.790039 --- ParallelTerminationStrategy: PID 16991 died... 11:38:16.810322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16991): Terminated: ok {rc=0} 11:38:16.901800 bus /sierra_3: Setting Powered False 11:38:17.999660 bus /sierra_3: Setting Powered False 11:38:19.116511 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:38:20.363511 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:38:20.370966 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:38:20.391441 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:38:20.418472 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:38:20.467975 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:38:20.488167 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:38:20.514540 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:38:21.068115 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:38:21.118090 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:21.129362 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:38:21.184703 tst mo_mt_call.py: using LAC 40635 11:38:21.304165 tst mo_mt_call.py: using RAC 90 11:38:21.424133 tst mo_mt_call.py: using CellId 40635 11:38:21.543866 tst mo_mt_call.py: using BVCI 40636 11:38:21.657232 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:21.668405 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:21.679498 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:21.690577 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:21.701773 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:21.713210 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:38:21.836333 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:38:21.958961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:22.474496 run create_hlr_db(pid=16998): Launched 11:38:22.611214 bus /sierra_2: Setting Powered False 11:38:23.676106 run create_hlr_db(pid=16998): Terminated: ok {rc=0} 11:38:24.118919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17000): Launched 11:38:24.429923 run osmo-hlr_10.42.42.2(pid=17001): Launched 11:38:24.547230 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:25.092650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17003): Launched 11:38:25.402372 run osmo-stp_10.42.42.5(pid=17004): Launched 11:38:25.519548 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:26.077952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17006): Launched 11:38:26.388419 run osmo-msc_10.42.42.6(pid=17007): Launched 11:38:26.561224 run osmo-stp_10.42.42.5(pid=17004): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17004)] 11:38:26.692461 run osmo-stp_10.42.42.5(pid=17004): stdout: | (launched: 2022-12-14_11:38:25.344421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:26.823420 run osmo-stp_10.42.42.5(pid=17004): stderr: | [0;m[38;5;43m20221214113825513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113825513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113825513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113825514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113825514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113825514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113825514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:26.952361 run osmo-stp_10.42.42.5(pid=17004): stdout: | (launched: 2022-12-14_11:38:25.344421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:27.075147 run osmo-stp_10.42.42.5(pid=17004): stderr: | [0;m[38;5;43m20221214113825513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113825513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113825513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113825514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113825514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113825514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113825514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:27.222403 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17004): Process ended prematurely: osmo-stp_10.42.42.5(pid=17004) [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17004)] [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:38:27.231415 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:38:27.258214 run osmo-hlr_10.42.42.2(pid=17001): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17001)] 11:38:27.307220 run osmo-hlr_10.42.42.2(pid=17001): stdout: | (launched: 2022-12-14_11:38:24.372464) 11:38:27.357639 run osmo-hlr_10.42.42.2(pid=17001): stderr: | [0;m[1;31m20221214113824548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113824548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113824548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113824548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113824548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113824548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113824561 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113824571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113824571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113824571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:27.428263 run osmo-msc_10.42.42.6(pid=17007): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17007)] 11:38:27.476480 run osmo-msc_10.42.42.6(pid=17007): stdout: | (launched: 2022-12-14_11:38:26.331073) 11:38:27.527763 run osmo-msc_10.42.42.6(pid=17007): stderr: | [0;m[38;5;43m20221214113826600 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113826600 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8bc149fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113826600 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113826600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113826600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113826600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113826602 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113826603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113826603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113826603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:27.578201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17000): Terminating (SIGTERM) 11:38:27.618873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17003): Terminating (SIGTERM) 11:38:27.659333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17006): Terminating (SIGTERM) 11:38:27.699822 --- ParallelTerminationStrategy: PID 17000 died... 11:38:27.719572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17000): Terminated: ok {rc=0} 11:38:27.764139 --- ParallelTerminationStrategy: PID 17003 died... 11:38:27.783257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17003): Terminated: ok {rc=0} 11:38:27.827919 --- ParallelTerminationStrategy: PID 17006 died... 11:38:27.847028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17006): Terminated: ok {rc=0} 11:38:27.932330 bus /sierra_3: Setting Powered False 11:38:29.027645 bus /sierra_3: Setting Powered False 11:38:30.144568 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:38:31.321939 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:31.338449 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:38:31.411349 tst mo_mt_call_osmux.py: using LAC 40636 11:38:31.536769 tst mo_mt_call_osmux.py: using RAC 91 11:38:31.671794 tst mo_mt_call_osmux.py: using CellId 40636 11:38:31.847749 tst mo_mt_call_osmux.py: using BVCI 40637 11:38:31.964758 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:31.977161 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:31.989250 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:32.001294 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:32.014579 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:32.027838 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:38:32.149657 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:38:32.271749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:32.754523 run create_hlr_db(pid=17009): Launched 11:38:32.875207 bus /sierra_2: Setting Powered False 11:38:33.936918 run create_hlr_db(pid=17009): Terminated: ok {rc=0} 11:38:34.369706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17011): Launched 11:38:34.680758 run osmo-hlr_10.42.42.2(pid=17012): Launched 11:38:34.798850 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:35.343222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17014): Launched 11:38:35.654503 run osmo-stp_10.42.42.5(pid=17015): Launched 11:38:35.775210 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:36.334623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17017): Launched 11:38:36.645473 run osmo-msc_10.42.42.6(pid=17018): Launched 11:38:36.818470 run osmo-stp_10.42.42.5(pid=17015): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17015)] 11:38:36.949908 run osmo-stp_10.42.42.5(pid=17015): stdout: | (launched: 2022-12-14_11:38:35.596551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:37.081093 run osmo-stp_10.42.42.5(pid=17015): stderr: | [0;m[38;5;43m20221214113835766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113835767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113835767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113835767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113835768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113835768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113835768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:37.210480 run osmo-stp_10.42.42.5(pid=17015): stdout: | (launched: 2022-12-14_11:38:35.596551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:37.333450 run osmo-stp_10.42.42.5(pid=17015): stderr: | [0;m[38;5;43m20221214113835766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113835767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113835767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113835767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113835768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113835768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113835768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:37.480540 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17015): Process ended prematurely: osmo-stp_10.42.42.5(pid=17015) [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17015)] [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:38:37.490011 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:38:37.516660 run osmo-hlr_10.42.42.2(pid=17012): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17012)] 11:38:37.565710 run osmo-hlr_10.42.42.2(pid=17012): stdout: | (launched: 2022-12-14_11:38:34.622929) 11:38:37.615567 run osmo-hlr_10.42.42.2(pid=17012): stderr: | [0;m[1;31m20221214113834796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113834797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113834797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113834797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113834797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113834797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113834810 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113834819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113834819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113834819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:37.685818 run osmo-msc_10.42.42.6(pid=17018): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17018)] 11:38:37.733842 run osmo-msc_10.42.42.6(pid=17018): stdout: | (launched: 2022-12-14_11:38:36.587835) 11:38:37.783665 run osmo-msc_10.42.42.6(pid=17018): stderr: | [0;m[38;5;43m20221214113836858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113836858 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb1852c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113836858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113836858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113836858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113836858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113836860 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113836860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113836861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113836861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:37.833957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17011): Terminating (SIGTERM) 11:38:37.874335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17014): Terminating (SIGTERM) 11:38:37.914640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17017): Terminating (SIGTERM) 11:38:37.955187 --- ParallelTerminationStrategy: PID 17011 died... 11:38:37.974945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17011): Terminated: ok {rc=0} 11:38:38.019595 --- ParallelTerminationStrategy: PID 17014 died... 11:38:38.038924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17014): Terminated: ok {rc=0} 11:38:38.083412 --- ParallelTerminationStrategy: PID 17017 died... 11:38:38.102623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17017): Terminated: ok {rc=0} 11:38:38.187146 bus /sierra_3: Setting Powered False 11:38:39.286082 bus /sierra_3: Setting Powered False 11:38:40.404063 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:38:41.638310 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:38:41.643855 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:38:41.664207 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:38:41.691675 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:38:41.744032 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:38:41.766194 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:38:41.794206 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:38:42.339068 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:38:42.390661 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:42.401799 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:38:42.457961 tst mo_mt_call.py: using LAC 40637 11:38:42.581420 tst mo_mt_call.py: using RAC 92 11:38:42.703124 tst mo_mt_call.py: using CellId 40637 11:38:42.826886 tst mo_mt_call.py: using BVCI 40638 11:38:42.940823 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:42.951818 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:42.962519 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:42.973148 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:42.984079 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:42.995132 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:38:43.113512 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:38:43.230850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:43.711585 run create_hlr_db(pid=17023): Launched 11:38:43.829337 bus /sierra_2: Setting Powered False 11:38:44.891116 run create_hlr_db(pid=17023): Terminated: ok {rc=0} 11:38:45.345677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17025): Launched 11:38:45.679588 run osmo-hlr_10.42.42.2(pid=17026): Launched 11:38:45.808082 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:46.485236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17028): Launched 11:38:46.828060 run osmo-stp_10.42.42.5(pid=17029): Launched 11:38:46.967434 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:47.631448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17031): Launched 11:38:47.942585 run osmo-msc_10.42.42.6(pid=17032): Launched 11:38:48.116343 run osmo-stp_10.42.42.5(pid=17029): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17029)] 11:38:48.247459 run osmo-stp_10.42.42.5(pid=17029): stdout: | (launched: 2022-12-14_11:38:46.765072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:48.378123 run osmo-stp_10.42.42.5(pid=17029): stderr: | [0;m[38;5;43m20221214113847124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113847124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113847132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113847132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113847133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113847133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113847133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:48.508152 run osmo-stp_10.42.42.5(pid=17029): stdout: | (launched: 2022-12-14_11:38:46.765072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:48.631452 run osmo-stp_10.42.42.5(pid=17029): stderr: | [0;m[38;5;43m20221214113847124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113847124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113847132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113847132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113847133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113847133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113847133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:48.778800 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17029): Process ended prematurely: osmo-stp_10.42.42.5(pid=17029) [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17029)] [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:38:48.787599 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:38:48.814458 run osmo-hlr_10.42.42.2(pid=17026): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17026)] 11:38:48.863563 run osmo-hlr_10.42.42.2(pid=17026): stdout: | (launched: 2022-12-14_11:38:45.618243) 11:38:48.914195 run osmo-hlr_10.42.42.2(pid=17026): stderr: | [0;m[1;31m20221214113845813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113845813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113845813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113845813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113845813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113845813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113845824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113845832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113845833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113845833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:48.984887 run osmo-msc_10.42.42.6(pid=17032): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17032)] 11:38:49.033392 run osmo-msc_10.42.42.6(pid=17032): stdout: | (launched: 2022-12-14_11:38:47.884620) 11:38:49.083679 run osmo-msc_10.42.42.6(pid=17032): stderr: | [0;m[38;5;43m20221214113848154 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113848154 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f3de23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113848155 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113848155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113848155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113848155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113848157 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113848157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113848157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113848157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:49.134249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17025): Terminating (SIGTERM) 11:38:49.174872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17028): Terminating (SIGTERM) 11:38:49.215414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17031): Terminating (SIGTERM) 11:38:49.256294 --- ParallelTerminationStrategy: PID 17025 died... 11:38:49.276129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17025): Terminated: ok {rc=0} 11:38:49.321774 --- ParallelTerminationStrategy: PID 17028 died... 11:38:49.341183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17028): Terminated: ok {rc=0} 11:38:49.385826 --- ParallelTerminationStrategy: PID 17031 died... 11:38:49.405143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17031): Terminated: ok {rc=0} 11:38:49.493412 bus /sierra_3: Setting Powered False 11:38:50.593659 bus /sierra_3: Setting Powered False 11:38:51.711110 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:38:52.860683 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:52.872182 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:38:52.929992 tst mo_mt_call_osmux.py: using LAC 40638 11:38:53.052020 tst mo_mt_call_osmux.py: using RAC 93 11:38:53.174972 tst mo_mt_call_osmux.py: using CellId 40638 11:38:53.296077 tst mo_mt_call_osmux.py: using BVCI 40639 11:38:53.409509 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:53.420429 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:53.431070 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:53.441773 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:53.452617 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:53.464133 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:38:53.587923 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:38:53.707002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:54.187666 run create_hlr_db(pid=17034): Launched 11:38:54.305502 bus /sierra_2: Setting Powered False 11:38:55.367231 run create_hlr_db(pid=17034): Terminated: ok {rc=0} 11:38:55.822701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17036): Launched 11:38:56.155814 run osmo-hlr_10.42.42.2(pid=17037): Launched 11:38:56.283319 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:56.862412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17039): Launched 11:38:57.194956 run osmo-stp_10.42.42.5(pid=17040): Launched 11:38:57.321767 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:57.930949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17042): Launched 11:38:58.263434 run osmo-msc_10.42.42.6(pid=17043): Launched 11:38:58.449414 run osmo-stp_10.42.42.5(pid=17040): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17040)] 11:38:58.589097 run osmo-stp_10.42.42.5(pid=17040): stdout: | (launched: 2022-12-14_11:38:57.133659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:58.728833 run osmo-stp_10.42.42.5(pid=17040): stderr: | [0;m[38;5;43m20221214113857324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113857324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113857324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113857325 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113857325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113857325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113857325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:58.867706 run osmo-stp_10.42.42.5(pid=17040): stdout: | (launched: 2022-12-14_11:38:57.133659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:58.999747 run osmo-stp_10.42.42.5(pid=17040): stderr: | [0;m[38;5;43m20221214113857324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113857324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113857324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113857325 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113857325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113857325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113857325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:59.158202 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17040): Process ended prematurely: osmo-stp_10.42.42.5(pid=17040) [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17040)] [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:38:59.167948 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:38:59.196020 run osmo-hlr_10.42.42.2(pid=17037): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17037)] 11:38:59.246659 run osmo-hlr_10.42.42.2(pid=17037): stdout: | (launched: 2022-12-14_11:38:56.094688) 11:38:59.299421 run osmo-hlr_10.42.42.2(pid=17037): stderr: | [0;m[1;31m20221214113856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113856289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113856302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113856310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113856310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113856310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:59.372887 run osmo-msc_10.42.42.6(pid=17043): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17043)] 11:38:59.423380 run osmo-msc_10.42.42.6(pid=17043): stdout: | (launched: 2022-12-14_11:38:58.202420) 11:38:59.475741 run osmo-msc_10.42.42.6(pid=17043): stderr: | [0;m[38;5;43m20221214113858521 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113858522 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb67ef39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113858522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113858522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113858522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113858522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113858524 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113858524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113858525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113858525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:59.528450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17036): Terminating (SIGTERM) 11:38:59.570859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17039): Terminating (SIGTERM) 11:38:59.613843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17042): Terminating (SIGTERM) 11:38:59.656419 --- ParallelTerminationStrategy: PID 17036 died... 11:38:59.677010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17036): Terminated: ok {rc=0} 11:38:59.723859 --- ParallelTerminationStrategy: PID 17039 died... 11:38:59.743659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17039): Terminated: ok {rc=0} 11:38:59.790586 --- ParallelTerminationStrategy: PID 17042 died... 11:38:59.810441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17042): Terminated: ok {rc=0} 11:38:59.899852 bus /sierra_3: Setting Powered False 11:39:01.010530 bus /sierra_3: Setting Powered False 11:39:02.168508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 emergency:oc2g --------------------------------------------------------------------- 11:39:03.456253 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:39:03.461217 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 11:39:03.494535 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 11:39:03.523193 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 11:39:03.610187 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 11:39:03.631826 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 11:39:03.659495 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 11:39:04.245870 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2404 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 11:39:04.252561 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:04.264260 tst emergency:oc2g: Using 1 x bts (candidates: 1) 11:39:04.302834 tst emergency_mo_mt_call.py: using LAC 40639 11:39:04.429249 tst emergency_mo_mt_call.py: using RAC 94 11:39:04.553887 tst emergency_mo_mt_call.py: using CellId 40639 11:39:04.676713 tst emergency_mo_mt_call.py: using BVCI 40640 11:39:04.791366 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:04.803082 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:04.815141 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:04.826995 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:04.839689 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:04.852341 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:39:04.977253 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:39:05.097352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:05.585229 run create_hlr_db(pid=17318): Launched 11:39:05.751405 bus /sierra_2: Setting Powered False 11:39:06.813243 run create_hlr_db(pid=17318): Terminated: ok {rc=0} 11:39:07.249525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17321): Launched 11:39:07.588039 run osmo-hlr_10.42.42.2(pid=17322): Launched 11:39:07.836308 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:08.506216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17324): Launched 11:39:08.837984 run osmo-stp_10.42.42.5(pid=17325): Launched 11:39:09.087247 tst emergency_mo_mt_call.py: using MSISDN 8667 11:39:09.389353 run osmo-msc_10.42.42.6: Starting osmo-msc 11:39:09.953763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17327): Launched 11:39:10.280636 run osmo-msc_10.42.42.6(pid=17328): Launched 11:39:10.641890 run osmo-stp_10.42.42.5(pid=17325): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17325)] 11:39:10.908669 run osmo-stp_10.42.42.5(pid=17325): stdout: | (launched: 2022-12-14_11:39:08.778772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:11.199859 run osmo-stp_10.42.42.5(pid=17325): stderr: | [0;m[38;5;43m20221214113909104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113909104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113909104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113909105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113909105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113909105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113909105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:11.356115 run osmo-stp_10.42.42.5(pid=17325): stdout: | (launched: 2022-12-14_11:39:08.778772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:11.480661 run osmo-stp_10.42.42.5(pid=17325): stderr: | [0;m[38;5;43m20221214113909104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113909104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113909104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113909105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113909105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113909105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113909105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:11.632138 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17325): Process ended prematurely: osmo-stp_10.42.42.5(pid=17325) [trial-2404↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17325)] [trial-2404↪emergency:oc2g↪emergency_mo_mt_call.py:19] 11:39:11.641910 tst emergency_mo_mt_call.py:19: Test FAILED (7.4 sec) 11:39:11.670057 run osmo-hlr_10.42.42.2(pid=17322): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17322)] 11:39:11.724830 run osmo-hlr_10.42.42.2(pid=17322): stdout: | (launched: 2022-12-14_11:39:07.528164) 11:39:11.776268 run osmo-hlr_10.42.42.2(pid=17322): stderr: | [0;m[1;31m20221214113907831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113907831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113907831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113907831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113907832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113907832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113907848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113907864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113907865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113907865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:11.850984 run osmo-msc_10.42.42.6(pid=17328): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17328)] 11:39:11.916441 run osmo-msc_10.42.42.6(pid=17328): stdout: | (launched: 2022-12-14_11:39:10.222802) 11:39:11.987911 run osmo-msc_10.42.42.6(pid=17328): stderr: | [0;m[38;5;43m20221214113910812 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113910812 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe62c972c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113910812 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113910812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113910815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113910816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113910817 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113910818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113910818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113910818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:39:12.040552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17321): Terminating (SIGTERM) 11:39:12.083103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17324): Terminating (SIGTERM) 11:39:12.129252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17327): Terminating (SIGTERM) 11:39:12.174748 --- ParallelTerminationStrategy: PID 17321 died... 11:39:12.196495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17321): Terminated: ok {rc=0} 11:39:12.245769 --- ParallelTerminationStrategy: PID 17324 died... 11:39:12.266776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17324): Terminated: ok {rc=0} 11:39:12.314684 --- ParallelTerminationStrategy: PID 17327 died... 11:39:12.337038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17327): Terminated: ok {rc=0} 11:39:12.428638 bus /sierra_3: Setting Powered False 11:39:13.530041 bus /sierra_3: Setting Powered False 11:39:14.654213 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 11:39:15.748330 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:15.761502 tst emergency:oc2g: Using 1 x bts (candidates: 1) 11:39:15.805850 tst emergency_preemptive_call.py: using LAC 40640 11:39:15.947082 tst emergency_preemptive_call.py: using RAC 95 11:39:16.098889 tst emergency_preemptive_call.py: using CellId 40640 11:39:16.235118 tst emergency_preemptive_call.py: using BVCI 40641 11:39:16.403728 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:16.422406 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:16.437279 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:16.452416 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:16.467447 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:39:16.480780 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:39:16.653779 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:39:16.830003 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:39:16.982654 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:39:17.134017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:17.658735 run create_hlr_db(pid=17330): Launched 11:39:17.828478 bus /sierra_2: Setting Powered False 11:39:18.891572 run create_hlr_db(pid=17330): Terminated: ok {rc=0} 11:39:19.349599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17332): Launched 11:39:19.678616 run osmo-hlr_10.42.42.2(pid=17333): Launched 11:39:19.917709 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:20.634730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17335): Launched 11:39:20.965227 run osmo-stp_10.42.42.5(pid=17336): Launched 11:39:21.220229 tst emergency_preemptive_call.py: using MSISDN 8668 11:39:21.511271 run osmo-msc_10.42.42.6: Starting osmo-msc 11:39:22.079062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17338): Launched 11:39:22.408374 run osmo-msc_10.42.42.6(pid=17339): Launched 11:39:22.758895 run osmo-stp_10.42.42.5(pid=17336): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17336)] 11:39:23.033479 run osmo-stp_10.42.42.5(pid=17336): stdout: | (launched: 2022-12-14_11:39:20.906258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:23.324325 run osmo-stp_10.42.42.5(pid=17336): stderr: | [0;m[38;5;43m20221214113921237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113921237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113921237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113921237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113921238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113921238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113921238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:23.475613 run osmo-stp_10.42.42.5(pid=17336): stdout: | (launched: 2022-12-14_11:39:20.906258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:23.602579 run osmo-stp_10.42.42.5(pid=17336): stderr: | [0;m[38;5;43m20221214113921237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113921237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113921237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113921237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113921238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113921238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113921238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:23.754414 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17336): Process ended prematurely: osmo-stp_10.42.42.5(pid=17336) [trial-2404↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17336)] [trial-2404↪emergency:oc2g↪emergency_preemptive_call.py:32] 11:39:23.763327 tst emergency_preemptive_call.py:32: Test FAILED (8.0 sec) 11:39:23.790642 run osmo-hlr_10.42.42.2(pid=17333): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17333)] 11:39:23.842565 run osmo-hlr_10.42.42.2(pid=17333): stdout: | (launched: 2022-12-14_11:39:19.619859) 11:39:23.895182 run osmo-hlr_10.42.42.2(pid=17333): stderr: | [0;m[1;31m20221214113919955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113919955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113919955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113919955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113919955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113919955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113919981 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113919995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113919995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113919996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:23.971368 run osmo-msc_10.42.42.6(pid=17339): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17339)] 11:39:24.021645 run osmo-msc_10.42.42.6(pid=17339): stdout: | (launched: 2022-12-14_11:39:22.350251) 11:39:24.075505 run osmo-msc_10.42.42.6(pid=17339): stderr: | [0;m[38;5;43m20221214113922943 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214113922943 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff0c7381c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214113922943 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214113922944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214113922944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214113922944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214113922946 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214113922946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214113922946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214113922946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:39:24.130159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17332): Terminating (SIGTERM) 11:39:24.172841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17335): Terminating (SIGTERM) 11:39:24.218333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17338): Terminating (SIGTERM) 11:39:24.264673 --- ParallelTerminationStrategy: PID 17332 died... 11:39:24.286355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17332): Terminated: ok {rc=0} 11:39:24.336571 --- ParallelTerminationStrategy: PID 17335 died... 11:39:24.357938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17335): Terminated: ok {rc=0} 11:39:24.405512 --- ParallelTerminationStrategy: PID 17338 died... 11:39:24.426839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17338): Terminated: ok {rc=0} 11:39:24.518751 bus /sierra_9: Setting Powered False 11:39:25.619770 bus /sierra_9: Setting Powered False 11:39:26.736751 bus /sierra_8: Setting Powered False 11:39:27.836350 bus /sierra_8: Setting Powered False 11:39:28.953072 bus /sierra_3: Setting Powered False 11:39:30.050888 bus /sierra_3: Setting Powered False 11:39:31.170954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:oc2g --------------------------------------------------------------------- 11:39:32.434838 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:39:32.439439 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 11:39:32.460356 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 11:39:32.499611 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 11:39:32.587942 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 11:39:32.609301 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 11:39:32.648757 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 11:39:33.240065 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 11:39:33.294015 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:33.304833 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:39:33.341369 tst cs_paging_gprs_active.py: using LAC 40641 11:39:33.464940 tst cs_paging_gprs_active.py: using RAC 96 11:39:33.588911 tst cs_paging_gprs_active.py: using CellId 40641 11:39:33.712390 tst cs_paging_gprs_active.py: using BVCI 40642 11:39:33.827055 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:33.837828 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:33.848284 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:33.858633 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:33.868691 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:33.880364 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:33.891183 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:33.901996 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:33.912824 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:39:34.036504 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:39:34.156471 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:39:34.366868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:34.679815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17346): Launched 11:39:34.951965 run iperf3-srv_10.42.42.10(pid=17347): Launched 11:39:35.068587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:39:35.275466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:35.586661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17348): Launched 11:39:35.859470 run iperf3-srv_10.42.42.10(pid=17349): Launched 11:39:35.976299 tst cs_paging_gprs_active.py:38: start network... 11:39:36.184496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:36.664030 run create_hlr_db(pid=17350): Launched 11:39:36.784664 bus /sierra_2: Setting Powered False 11:39:37.846295 run create_hlr_db(pid=17350): Terminated: ok {rc=0} 11:39:38.300796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17352): Launched 11:39:38.636153 run osmo-hlr_10.42.42.2(pid=17353): Launched 11:39:38.764484 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:39.337696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17355): Launched 11:39:39.671507 run osmo-stp_10.42.42.5(pid=17356): Launched 11:39:39.799995 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:40.373096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17358): Launched 11:39:40.501724 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:40.782558 run patchelf(pid=17359): Launched 11:39:40.967929 run osmo-stp_10.42.42.5(pid=17356): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17356)] 11:39:41.108264 run osmo-stp_10.42.42.5(pid=17356): stdout: | (launched: 2022-12-14_11:39:39.610278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:41.251183 run osmo-stp_10.42.42.5(pid=17356): stderr: | [0;m[38;5;43m20221214113939800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113939800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113939800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113939801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113939801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113939801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113939801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:41.393806 run osmo-stp_10.42.42.5(pid=17356): stdout: | (launched: 2022-12-14_11:39:39.610278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:41.529836 run osmo-stp_10.42.42.5(pid=17356): stderr: | [0;m[38;5;43m20221214113939800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113939800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113939800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113939801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113939801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113939801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113939801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:41.691433 run patchelf(pid=17359): Terminating (SIGINT) 11:39:41.878744 run patchelf(pid=17359): Terminated: ok {rc=0} 11:39:42.013498 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17356): Process ended prematurely: osmo-stp_10.42.42.5(pid=17356) [trial-2404↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17356)] [trial-2404↪gprs:oc2g↪cs_paging_gprs_active.py:38] 11:39:42.023587 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:39:42.052401 run osmo-hlr_10.42.42.2(pid=17353): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17353)] 11:39:42.102972 run osmo-hlr_10.42.42.2(pid=17353): stdout: | (launched: 2022-12-14_11:39:38.574597) 11:39:42.155099 run osmo-hlr_10.42.42.2(pid=17353): stderr: | [0;m[1;31m20221214113938770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113938770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113938770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113938770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113938770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113938771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113938783 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113938792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113938792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113938792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:42.207649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17346): Terminating (SIGTERM) 11:39:42.249706 run iperf3-srv_10.42.42.10(pid=17347): Terminating (SIGTERM) 11:39:42.291623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17348): Terminating (SIGTERM) 11:39:42.333917 run iperf3-srv_10.42.42.10(pid=17349): Terminating (SIGTERM) 11:39:42.375841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17352): Terminating (SIGTERM) 11:39:42.418018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17355): Terminating (SIGTERM) 11:39:42.460523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17358): Terminating (SIGTERM) 11:39:42.503330 --- ParallelTerminationStrategy: PID 17346 died... 11:39:42.523573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17346): Terminated: ok {rc=0} 11:39:42.569938 --- ParallelTerminationStrategy: PID 17347 died... 11:39:42.589566 run iperf3-srv_10.42.42.10(pid=17347): Terminated {rc=256} 11:39:42.635432 --- ParallelTerminationStrategy: PID 17348 died... 11:39:42.654994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17348): Terminated: ok {rc=0} 11:39:42.701295 --- ParallelTerminationStrategy: PID 17349 died... 11:39:42.720738 run iperf3-srv_10.42.42.10(pid=17349): Terminated {rc=256} 11:39:42.766933 --- ParallelTerminationStrategy: PID 17352 died... 11:39:42.786842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17352): Terminated: ok {rc=0} 11:39:42.833063 --- ParallelTerminationStrategy: PID 17355 died... 11:39:42.852724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17355): Terminated: ok {rc=0} 11:39:42.899361 --- ParallelTerminationStrategy: PID 17358 died... 11:39:42.918874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17358): Terminated: ok {rc=0} 11:39:43.007091 bus /gobi_0: Setting Powered False 11:39:44.106514 bus /gobi_0: Setting Powered False 11:39:45.224557 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g iperf3.py ---------------------------------------------- 11:39:46.401820 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:46.414646 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:39:46.453280 tst iperf3.py: using LAC 40642 11:39:46.591582 tst iperf3.py: using RAC 97 11:39:46.725699 tst iperf3.py: using CellId 40642 11:39:46.849901 tst iperf3.py: using BVCI 40643 11:39:47.025122 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:47.037434 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:47.049902 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:47.061801 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:47.074489 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:47.087181 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:47.100072 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:47.112788 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:47.125847 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:39:47.255377 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:39:47.465972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:47.777763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17360): Launched 11:39:48.047170 run iperf3-srv_10.42.42.10(pid=17361): Launched 11:39:48.163014 tst iperf3.py:8: start network... 11:39:48.369631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:48.847783 run create_hlr_db(pid=17362): Launched 11:39:48.968223 bus /gobi_6: Setting Powered False 11:39:50.028745 run create_hlr_db(pid=17362): Terminated: ok {rc=0} 11:39:50.483415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17364): Launched 11:39:50.817542 run osmo-hlr_10.42.42.2(pid=17365): Launched 11:39:50.944522 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:51.519708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17367): Launched 11:39:51.854723 run osmo-stp_10.42.42.5(pid=17368): Launched 11:39:51.982088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:39:52.558673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17370): Launched 11:39:52.686238 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:39:52.968559 run patchelf(pid=17371): Launched 11:39:53.155238 run osmo-stp_10.42.42.5(pid=17368): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17368)] 11:39:53.295574 run osmo-stp_10.42.42.5(pid=17368): stdout: | (launched: 2022-12-14_11:39:51.792869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:53.437311 run osmo-stp_10.42.42.5(pid=17368): stderr: | [0;m[38;5;43m20221214113951984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113951984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113951985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113951985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113951986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113951986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113951986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:53.579731 run osmo-stp_10.42.42.5(pid=17368): stdout: | (launched: 2022-12-14_11:39:51.792869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:53.715284 run osmo-stp_10.42.42.5(pid=17368): stderr: | [0;m[38;5;43m20221214113951984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214113951984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214113951985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214113951985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214113951986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214113951986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214113951986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:53.876736 run patchelf(pid=17371): Terminating (SIGINT) 11:39:54.063257 run patchelf(pid=17371): Terminated: ok {rc=0} 11:39:54.197499 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17368): Process ended prematurely: osmo-stp_10.42.42.5(pid=17368) [trial-2404↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17368)] [trial-2404↪gprs:oc2g↪iperf3.py:8] 11:39:54.207759 tst iperf3.py:8: Test FAILED (7.9 sec) 11:39:54.236362 run osmo-hlr_10.42.42.2(pid=17365): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17365)] 11:39:54.286143 run osmo-hlr_10.42.42.2(pid=17365): stdout: | (launched: 2022-12-14_11:39:50.756054) 11:39:54.337746 run osmo-hlr_10.42.42.2(pid=17365): stderr: | [0;m[1;31m20221214113950954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214113950954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214113950954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214113950954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214113950954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214113950955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214113950967 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214113950975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214113950975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214113950976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:54.389900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17360): Terminating (SIGTERM) 11:39:54.431918 run iperf3-srv_10.42.42.10(pid=17361): Terminating (SIGTERM) 11:39:54.473948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17364): Terminating (SIGTERM) 11:39:54.516560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17367): Terminating (SIGTERM) 11:39:54.559055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17370): Terminating (SIGTERM) 11:39:54.601835 --- ParallelTerminationStrategy: PID 17360 died... 11:39:54.621994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17360): Terminated: ok {rc=0} 11:39:54.668130 --- ParallelTerminationStrategy: PID 17361 died... 11:39:54.687694 run iperf3-srv_10.42.42.10(pid=17361): Terminated {rc=256} 11:39:54.733990 --- ParallelTerminationStrategy: PID 17364 died... 11:39:54.753759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17364): Terminated: ok {rc=0} 11:39:54.800335 --- ParallelTerminationStrategy: PID 17367 died... 11:39:54.819965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17367): Terminated: ok {rc=0} 11:39:54.866307 --- ParallelTerminationStrategy: PID 17370 died... 11:39:54.885921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17370): Terminated: ok {rc=0} 11:39:54.975110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g iperf3m4.py ---------------------------------------------- 11:39:56.126054 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:56.137830 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:39:56.174498 tst iperf3m4.py: using LAC 40643 11:39:56.305147 tst iperf3m4.py: using RAC 98 11:39:56.434719 tst iperf3m4.py: using CellId 40643 11:39:56.566427 tst iperf3m4.py: using BVCI 40644 11:39:56.688808 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:56.699827 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:56.710824 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:56.721791 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:56.732817 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:56.743776 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:56.754931 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:56.765840 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:39:56.776736 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:39:56.897661 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:39:57.018525 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:39:57.139532 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:39:57.257853 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:39:57.465196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:57.781737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17372): Launched 11:39:58.075010 run iperf3-srv_10.42.42.10(pid=17373): Launched 11:39:58.201301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:39:58.426214 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:58.760247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17374): Launched 11:39:59.052197 run iperf3-srv_10.42.42.10(pid=17375): Launched 11:39:59.178167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:39:59.401820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:39:59.736113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17376): Launched 11:40:00.027348 run iperf3-srv_10.42.42.10(pid=17377): Launched 11:40:00.153116 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:40:00.376247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:00.709747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17378): Launched 11:40:01.018312 run iperf3-srv_10.42.42.10(pid=17379): Launched 11:40:01.149956 tst iperf3m4.py:8: start network... 11:40:01.377416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:01.917491 run create_hlr_db(pid=17383): Launched 11:40:02.081621 bus /gobi_6: Setting Powered False 11:40:03.143685 run create_hlr_db(pid=17383): Terminated: ok {rc=0} 11:40:03.603139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17385): Launched 11:40:03.936765 run osmo-hlr_10.42.42.2(pid=17386): Launched 11:40:04.062742 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:04.634083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17388): Launched 11:40:04.968838 run osmo-stp_10.42.42.5(pid=17389): Launched 11:40:05.095930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:05.668743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17391): Launched 11:40:05.797791 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:06.080175 run patchelf(pid=17392): Launched 11:40:06.266586 run osmo-stp_10.42.42.5(pid=17389): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17389)] 11:40:06.406968 run osmo-stp_10.42.42.5(pid=17389): stdout: | (launched: 2022-12-14_11:40:04.907439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:06.548626 run osmo-stp_10.42.42.5(pid=17389): stderr: | [0;m[38;5;43m20221214114005096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114005097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114005097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114005097 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114005098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114005098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114005098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:06.690874 run osmo-stp_10.42.42.5(pid=17389): stdout: | (launched: 2022-12-14_11:40:04.907439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:06.827290 run osmo-stp_10.42.42.5(pid=17389): stderr: | [0;m[38;5;43m20221214114005096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114005097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114005097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114005097 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114005098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114005098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114005098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:06.988726 run patchelf(pid=17392): Terminating (SIGINT) 11:40:07.175476 run patchelf(pid=17392): Terminated: ok {rc=0} 11:40:07.309352 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17389): Process ended prematurely: osmo-stp_10.42.42.5(pid=17389) [trial-2404↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17389)] [trial-2404↪gprs:oc2g↪iperf3m4.py:8] 11:40:07.319490 tst iperf3m4.py:8: Test FAILED (11.2 sec) 11:40:07.348416 run osmo-hlr_10.42.42.2(pid=17386): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17386)] 11:40:07.398325 run osmo-hlr_10.42.42.2(pid=17386): stdout: | (launched: 2022-12-14_11:40:03.875498) 11:40:07.449979 run osmo-hlr_10.42.42.2(pid=17386): stderr: | [0;m[1;31m20221214114004070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114004070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114004070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114004070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114004070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114004070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114004082 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114004091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114004091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114004091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:07.502096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17372): Terminating (SIGTERM) 11:40:07.544121 run iperf3-srv_10.42.42.10(pid=17373): Terminating (SIGTERM) 11:40:07.586306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17374): Terminating (SIGTERM) 11:40:07.628036 run iperf3-srv_10.42.42.10(pid=17375): Terminating (SIGTERM) 11:40:07.669686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17376): Terminating (SIGTERM) 11:40:07.711854 run iperf3-srv_10.42.42.10(pid=17377): Terminating (SIGTERM) 11:40:07.753461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17378): Terminating (SIGTERM) 11:40:07.795964 run iperf3-srv_10.42.42.10(pid=17379): Terminating (SIGTERM) 11:40:07.837419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17385): Terminating (SIGTERM) 11:40:07.879718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17388): Terminating (SIGTERM) 11:40:07.921881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17391): Terminating (SIGTERM) 11:40:07.964219 --- ParallelTerminationStrategy: PID 17372 died... 11:40:07.984198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17372): Terminated: ok {rc=0} 11:40:08.030317 --- ParallelTerminationStrategy: PID 17373 died... 11:40:08.049620 run iperf3-srv_10.42.42.10(pid=17373): Terminated {rc=256} 11:40:08.095616 --- ParallelTerminationStrategy: PID 17374 died... 11:40:08.115152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17374): Terminated: ok {rc=0} 11:40:08.160823 --- ParallelTerminationStrategy: PID 17375 died... 11:40:08.180772 run iperf3-srv_10.42.42.10(pid=17375): Terminated {rc=256} 11:40:08.226533 --- ParallelTerminationStrategy: PID 17376 died... 11:40:08.246145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17376): Terminated: ok {rc=0} 11:40:08.292211 --- ParallelTerminationStrategy: PID 17377 died... 11:40:08.311825 run iperf3-srv_10.42.42.10(pid=17377): Terminated {rc=256} 11:40:08.357991 --- ParallelTerminationStrategy: PID 17378 died... 11:40:08.377661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17378): Terminated: ok {rc=0} 11:40:08.423598 --- ParallelTerminationStrategy: PID 17379 died... 11:40:08.443315 run iperf3-srv_10.42.42.10(pid=17379): Terminated {rc=256} 11:40:08.489282 --- ParallelTerminationStrategy: PID 17385 died... 11:40:08.508754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17385): Terminated: ok {rc=0} 11:40:08.554940 --- ParallelTerminationStrategy: PID 17388 died... 11:40:08.574595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17388): Terminated: ok {rc=0} 11:40:08.620399 --- ParallelTerminationStrategy: PID 17391 died... 11:40:08.640058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17391): Terminated: ok {rc=0} 11:40:08.728000 bus /gobi_4: Setting Powered False 11:40:09.827853 bus /gobi_4: Setting Powered False 11:40:10.948034 bus /gobi_1: Setting Powered False 11:40:12.047621 bus /gobi_1: Setting Powered False 11:40:13.164560 bus /gobi_0: Setting Powered False 11:40:14.261994 bus /gobi_0: Setting Powered False 11:40:15.375428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g ping.py ---------------------------------------------- 11:40:16.476890 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:16.489236 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:40:16.526177 tst ping.py: using LAC 40644 11:40:16.691843 tst ping.py: using RAC 99 11:40:16.814864 tst ping.py: using CellId 40644 11:40:16.953714 tst ping.py: using BVCI 40645 11:40:17.069614 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:17.081229 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:17.092745 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:17.104390 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:17.117076 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:17.130242 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:17.142913 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:17.155338 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:40:17.276834 tst ping.py:19: start network... 11:40:17.482967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:17.950875 run create_hlr_db(pid=17393): Launched 11:40:18.068487 bus /gobi_6: Setting Powered False 11:40:19.129682 run create_hlr_db(pid=17393): Terminated: ok {rc=0} 11:40:19.554412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17395): Launched 11:40:19.861046 run osmo-hlr_10.42.42.2(pid=17396): Launched 11:40:19.978526 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:20.515072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17398): Launched 11:40:20.822421 run osmo-stp_10.42.42.5(pid=17399): Launched 11:40:20.939000 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:21.464420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17401): Launched 11:40:21.581632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:21.839916 run patchelf(pid=17402): Launched 11:40:22.011731 run osmo-stp_10.42.42.5(pid=17399): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17399)] 11:40:22.141726 run osmo-stp_10.42.42.5(pid=17399): stdout: | (launched: 2022-12-14_11:40:20.765393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:22.273301 run osmo-stp_10.42.42.5(pid=17399): stderr: | [0;m[38;5;43m20221214114020934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114020934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114020934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114020935 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114020935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114020935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114020935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:22.404880 run osmo-stp_10.42.42.5(pid=17399): stdout: | (launched: 2022-12-14_11:40:20.765393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:22.530415 run osmo-stp_10.42.42.5(pid=17399): stderr: | [0;m[38;5;43m20221214114020934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114020934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114020934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114020935 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114020935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114020935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114020935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:22.678191 run patchelf(pid=17402): Terminating (SIGINT) 11:40:22.849542 run patchelf(pid=17402): Terminated: ok {rc=0} 11:40:22.972573 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17399): Process ended prematurely: osmo-stp_10.42.42.5(pid=17399) [trial-2404↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17399)] [trial-2404↪gprs:oc2g↪ping.py:22] 11:40:22.981459 tst ping.py:22: Test FAILED (6.5 sec) 11:40:23.008795 run osmo-hlr_10.42.42.2(pid=17396): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17396)] 11:40:23.057994 run osmo-hlr_10.42.42.2(pid=17396): stdout: | (launched: 2022-12-14_11:40:19.804188) 11:40:23.108389 run osmo-hlr_10.42.42.2(pid=17396): stderr: | [0;m[1;31m20221214114019979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114019979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114019980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114019980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114019980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114019980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114019991 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114019999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114019999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114019999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:23.159322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17395): Terminating (SIGTERM) 11:40:23.200652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17398): Terminating (SIGTERM) 11:40:23.241598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17401): Terminating (SIGTERM) 11:40:23.282878 --- ParallelTerminationStrategy: PID 17395 died... 11:40:23.302904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17395): Terminated: ok {rc=0} 11:40:23.348150 --- ParallelTerminationStrategy: PID 17398 died... 11:40:23.367864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17398): Terminated: ok {rc=0} 11:40:23.412784 --- ParallelTerminationStrategy: PID 17401 died... 11:40:23.432523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17401): Terminated: ok {rc=0} 11:40:23.518127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 11:40:24.603053 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:24.614496 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:40:24.650558 tst ping_idle_ping.py: using LAC 40645 11:40:24.774810 tst ping_idle_ping.py: using RAC 100 11:40:24.893799 tst ping_idle_ping.py: using CellId 40645 11:40:25.013717 tst ping_idle_ping.py: using BVCI 40646 11:40:25.126728 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:25.137501 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:25.148164 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:25.158779 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:25.169675 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:25.181149 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:25.192255 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:40:25.203394 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:40:25.321079 tst ping_idle_ping.py:24: start network... 11:40:25.525739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:25.999930 run create_hlr_db(pid=17403): Launched 11:40:26.118014 bus /gobi_6: Setting Powered False 11:40:27.179545 run create_hlr_db(pid=17403): Terminated: ok {rc=0} 11:40:27.609456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17405): Launched 11:40:27.918214 run osmo-hlr_10.42.42.2(pid=17406): Launched 11:40:28.035743 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:28.574968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17408): Launched 11:40:28.883588 run osmo-stp_10.42.42.5(pid=17409): Launched 11:40:29.001565 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:29.529671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17411): Launched 11:40:29.646877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:29.905852 run patchelf(pid=17412): Launched 11:40:30.077792 run osmo-stp_10.42.42.5(pid=17409): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17409)] 11:40:30.207993 run osmo-stp_10.42.42.5(pid=17409): stdout: | (launched: 2022-12-14_11:40:28.826477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:30.339798 run osmo-stp_10.42.42.5(pid=17409): stderr: | [0;m[38;5;43m20221214114028997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114028997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114028997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114028997 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114028998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114028998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114028998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:30.472462 run osmo-stp_10.42.42.5(pid=17409): stdout: | (launched: 2022-12-14_11:40:28.826477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:30.597497 run osmo-stp_10.42.42.5(pid=17409): stderr: | [0;m[38;5;43m20221214114028997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114028997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114028997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114028997 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114028998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114028998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114028998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:30.746236 run patchelf(pid=17412): Terminating (SIGINT) 11:40:30.934603 run patchelf(pid=17412): Terminated: ok {rc=0} 11:40:31.061937 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17409): Process ended prematurely: osmo-stp_10.42.42.5(pid=17409) [trial-2404↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17409)] [trial-2404↪gprs:oc2g↪ping_idle_ping.py:27] 11:40:31.071993 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:40:31.100252 run osmo-hlr_10.42.42.2(pid=17406): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17406)] 11:40:31.151732 run osmo-hlr_10.42.42.2(pid=17406): stdout: | (launched: 2022-12-14_11:40:27.860748) 11:40:31.203775 run osmo-hlr_10.42.42.2(pid=17406): stderr: | [0;m[1;31m20221214114028036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114028036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114028036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114028036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114028037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114028037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114028048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114028056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114028057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114028057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:31.257637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17405): Terminating (SIGTERM) 11:40:31.299525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17408): Terminating (SIGTERM) 11:40:31.343542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17411): Terminating (SIGTERM) 11:40:31.386394 --- ParallelTerminationStrategy: PID 17405 died... 11:40:31.407576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17405): Terminated: ok {rc=0} 11:40:31.454389 --- ParallelTerminationStrategy: PID 17408 died... 11:40:31.475420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17408): Terminated: ok {rc=0} 11:40:31.522301 --- ParallelTerminationStrategy: PID 17411 died... 11:40:31.543464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17411): Terminated: ok {rc=0} 11:40:31.637257 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 11:40:32.935388 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:40:32.940705 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:40:32.961130 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:40:33.001305 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:40:33.088369 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:40:33.108825 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:40:33.147696 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:40:33.743970 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:40:33.797594 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:33.809226 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:40:33.851272 tst cs_paging_gprs_active.py: using LAC 40646 11:40:33.982643 tst cs_paging_gprs_active.py: using RAC 101 11:40:34.109032 tst cs_paging_gprs_active.py: using CellId 40646 11:40:34.234922 tst cs_paging_gprs_active.py: using BVCI 40647 11:40:34.354619 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:34.366117 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:34.377374 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:34.388478 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:34.399729 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:34.410960 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:34.422487 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:34.433775 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:34.445247 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:34.563392 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:34.683020 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:40:34.902510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:35.229777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17416): Launched 11:40:35.514239 run iperf3-srv_10.42.42.10(pid=17417): Launched 11:40:35.636430 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:40:35.854804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:36.181094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17418): Launched 11:40:36.464575 run iperf3-srv_10.42.42.10(pid=17419): Launched 11:40:36.586719 tst cs_paging_gprs_active.py:38: start network... 11:40:36.805346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:37.311596 run create_hlr_db(pid=17420): Launched 11:40:37.446249 bus /gobi_6: Setting Powered False 11:40:38.509820 run create_hlr_db(pid=17420): Terminated: ok {rc=0} 11:40:38.965963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17422): Launched 11:40:39.293465 run osmo-hlr_10.42.42.2(pid=17423): Launched 11:40:39.419953 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:39.988606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17425): Launched 11:40:40.316476 run osmo-stp_10.42.42.5(pid=17426): Launched 11:40:40.440014 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:41.002195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17428): Launched 11:40:41.127269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:41.403910 run patchelf(pid=17429): Launched 11:40:41.587201 run osmo-stp_10.42.42.5(pid=17426): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17426)] 11:40:41.725800 run osmo-stp_10.42.42.5(pid=17426): stdout: | (launched: 2022-12-14_11:40:40.256720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:41.866276 run osmo-stp_10.42.42.5(pid=17426): stderr: | [0;m[38;5;43m20221214114040445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114040445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114040446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114040446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114040446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114040447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114040447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:42.007100 run osmo-stp_10.42.42.5(pid=17426): stdout: | (launched: 2022-12-14_11:40:40.256720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:42.141147 run osmo-stp_10.42.42.5(pid=17426): stderr: | [0;m[38;5;43m20221214114040445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114040445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114040446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114040446 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114040446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114040447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114040447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:42.299457 run patchelf(pid=17429): Terminating (SIGINT) 11:40:42.482202 run patchelf(pid=17429): Terminated: ok {rc=0} 11:40:42.614257 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17426): Process ended prematurely: osmo-stp_10.42.42.5(pid=17426) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17426)] [trial-2404↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:40:42.624684 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:40:42.653394 run osmo-hlr_10.42.42.2(pid=17423): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17423)] 11:40:42.704157 run osmo-hlr_10.42.42.2(pid=17423): stdout: | (launched: 2022-12-14_11:40:39.233390) 11:40:42.756489 run osmo-hlr_10.42.42.2(pid=17423): stderr: | [0;m[1;31m20221214114039431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114039431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114039431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114039431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114039431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114039431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114039444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114039452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114039452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114039453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:42.810198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17416): Terminating (SIGTERM) 11:40:42.852777 run iperf3-srv_10.42.42.10(pid=17417): Terminating (SIGTERM) 11:40:42.895517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17418): Terminating (SIGTERM) 11:40:42.938263 run iperf3-srv_10.42.42.10(pid=17419): Terminating (SIGTERM) 11:40:42.980704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17422): Terminating (SIGTERM) 11:40:43.023407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17425): Terminating (SIGTERM) 11:40:43.066024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17428): Terminating (SIGTERM) 11:40:43.109231 --- ParallelTerminationStrategy: PID 17416 died... 11:40:43.129815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17416): Terminated: ok {rc=0} 11:40:43.176895 --- ParallelTerminationStrategy: PID 17417 died... 11:40:43.197258 run iperf3-srv_10.42.42.10(pid=17417): Terminated {rc=256} 11:40:43.243715 --- ParallelTerminationStrategy: PID 17418 died... 11:40:43.263527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17418): Terminated: ok {rc=0} 11:40:43.310090 --- ParallelTerminationStrategy: PID 17419 died... 11:40:43.329990 run iperf3-srv_10.42.42.10(pid=17419): Terminated {rc=256} 11:40:43.377164 --- ParallelTerminationStrategy: PID 17422 died... 11:40:43.396989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17422): Terminated: ok {rc=0} 11:40:43.443246 --- ParallelTerminationStrategy: PID 17425 died... 11:40:43.463170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17425): Terminated: ok {rc=0} 11:40:43.509609 --- ParallelTerminationStrategy: PID 17428 died... 11:40:43.529820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17428): Terminated: ok {rc=0} 11:40:43.618033 bus /gobi_0: Setting Powered False 11:40:44.717637 bus /gobi_0: Setting Powered False 11:40:45.835625 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:40:46.981932 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:46.994351 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:40:47.032229 tst iperf3.py: using LAC 40647 11:40:47.165190 tst iperf3.py: using RAC 102 11:40:47.294782 tst iperf3.py: using CellId 40647 11:40:47.415724 tst iperf3.py: using BVCI 40648 11:40:47.527980 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:47.538829 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:47.549497 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:47.560068 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:47.570827 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:47.581696 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:47.592894 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:47.603704 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:47.614701 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:47.732669 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:40:47.936378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:48.242379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17430): Launched 11:40:48.513742 run iperf3-srv_10.42.42.10(pid=17431): Launched 11:40:48.637544 tst iperf3.py:8: start network... 11:40:48.857478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:49.363433 run create_hlr_db(pid=17432): Launched 11:40:49.495876 bus /gobi_6: Setting Powered False 11:40:50.559369 run create_hlr_db(pid=17432): Terminated: ok {rc=0} 11:40:50.995064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17434): Launched 11:40:51.299276 run osmo-hlr_10.42.42.2(pid=17435): Launched 11:40:51.415154 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:51.952195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17437): Launched 11:40:52.277656 run osmo-stp_10.42.42.5(pid=17442): Launched 11:40:52.403211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:52.967497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17444): Launched 11:40:53.093098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:53.368492 run patchelf(pid=17445): Launched 11:40:53.551488 run osmo-stp_10.42.42.5(pid=17442): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17442)] 11:40:53.689754 run osmo-stp_10.42.42.5(pid=17442): stdout: | (launched: 2022-12-14_11:40:52.217532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:53.829798 run osmo-stp_10.42.42.5(pid=17442): stderr: | [0;m[38;5;43m20221214114052408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114052408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114052409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114052409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114052410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114052410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114052410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:53.969692 run osmo-stp_10.42.42.5(pid=17442): stdout: | (launched: 2022-12-14_11:40:52.217532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:54.103355 run osmo-stp_10.42.42.5(pid=17442): stderr: | [0;m[38;5;43m20221214114052408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114052408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114052409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114052409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114052410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114052410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114052410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:54.261426 run patchelf(pid=17445): Terminating (SIGINT) 11:40:54.443896 run patchelf(pid=17445): Terminated: ok {rc=0} 11:40:54.575543 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17442): Process ended prematurely: osmo-stp_10.42.42.5(pid=17442) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17442)] [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 11:40:54.585809 tst iperf3.py:8: Test FAILED (7.6 sec) 11:40:54.614389 run osmo-hlr_10.42.42.2(pid=17435): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17435)] 11:40:54.665185 run osmo-hlr_10.42.42.2(pid=17435): stdout: | (launched: 2022-12-14_11:40:51.243085) 11:40:54.717409 run osmo-hlr_10.42.42.2(pid=17435): stderr: | [0;m[1;31m20221214114051418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114051418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114051418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114051418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114051418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114051418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114051430 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114051439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114051439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114051439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:54.769942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17430): Terminating (SIGTERM) 11:40:54.812413 run iperf3-srv_10.42.42.10(pid=17431): Terminating (SIGTERM) 11:40:54.855158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17434): Terminating (SIGTERM) 11:40:54.897742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17437): Terminating (SIGTERM) 11:40:54.940273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17444): Terminating (SIGTERM) 11:40:54.982918 --- ParallelTerminationStrategy: PID 17430 died... 11:40:55.003109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17430): Terminated: ok {rc=0} 11:40:55.049750 --- ParallelTerminationStrategy: PID 17431 died... 11:40:55.069390 run iperf3-srv_10.42.42.10(pid=17431): Terminated {rc=256} 11:40:55.116011 --- ParallelTerminationStrategy: PID 17434 died... 11:40:55.135867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17434): Terminated: ok {rc=0} 11:40:55.182497 --- ParallelTerminationStrategy: PID 17437 died... 11:40:55.202390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17437): Terminated: ok {rc=0} 11:40:55.249116 --- ParallelTerminationStrategy: PID 17444 died... 11:40:55.268839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17444): Terminated: ok {rc=0} 11:40:55.358149 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:40:56.509522 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:56.521354 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:40:56.558827 tst iperf3m4.py: using LAC 40648 11:40:56.687759 tst iperf3m4.py: using RAC 103 11:40:56.814184 tst iperf3m4.py: using CellId 40648 11:40:56.943556 tst iperf3m4.py: using BVCI 40649 11:40:57.062461 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:57.073857 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:57.084931 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:57.096056 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:57.107068 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:57.118042 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:57.129320 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:57.140212 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:40:57.151543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:57.272359 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:57.393305 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:57.512794 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:40:57.632863 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:40:57.851605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:58.179482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17446): Launched 11:40:58.464282 run iperf3-srv_10.42.42.10(pid=17447): Launched 11:40:58.586359 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:40:58.804781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:59.133483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17448): Launched 11:40:59.417446 run iperf3-srv_10.42.42.10(pid=17449): Launched 11:40:59.539392 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:40:59.757786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:00.086425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17450): Launched 11:41:00.370590 run iperf3-srv_10.42.42.10(pid=17451): Launched 11:41:00.492296 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:41:00.710547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:01.065599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17452): Launched 11:41:01.355439 run iperf3-srv_10.42.42.10(pid=17453): Launched 11:41:01.487268 tst iperf3m4.py:8: start network... 11:41:01.698299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:02.207377 run create_hlr_db(pid=17454): Launched 11:41:02.339065 bus /gobi_6: Setting Powered False 11:41:03.402684 run create_hlr_db(pid=17454): Terminated: ok {rc=0} 11:41:03.836856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17456): Launched 11:41:04.143861 run osmo-hlr_10.42.42.2(pid=17457): Launched 11:41:04.259319 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:04.794640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17459): Launched 11:41:05.099724 run osmo-stp_10.42.42.5(pid=17460): Launched 11:41:05.215354 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:05.740941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17462): Launched 11:41:05.860037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:06.119744 run patchelf(pid=17463): Launched 11:41:06.291052 run osmo-stp_10.42.42.5(pid=17460): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17460)] 11:41:06.421387 run osmo-stp_10.42.42.5(pid=17460): stdout: | (launched: 2022-12-14_11:41:05.043320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:06.553462 run osmo-stp_10.42.42.5(pid=17460): stderr: | [0;m[38;5;43m20221214114105213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114105213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114105214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114105214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114105215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114105215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114105215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:06.685299 run osmo-stp_10.42.42.5(pid=17460): stdout: | (launched: 2022-12-14_11:41:05.043320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:06.810767 run osmo-stp_10.42.42.5(pid=17460): stderr: | [0;m[38;5;43m20221214114105213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114105213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114105214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114105214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114105215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114105215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114105215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:06.959721 run patchelf(pid=17463): Terminating (SIGINT) 11:41:07.131893 run patchelf(pid=17463): Terminated: ok {rc=0} 11:41:07.256336 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17460): Process ended prematurely: osmo-stp_10.42.42.5(pid=17460) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17460)] [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 11:41:07.266009 tst iperf3m4.py:8: Test FAILED (10.8 sec) 11:41:07.293514 run osmo-hlr_10.42.42.2(pid=17457): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17457)] 11:41:07.342610 run osmo-hlr_10.42.42.2(pid=17457): stdout: | (launched: 2022-12-14_11:41:04.086971) 11:41:07.392783 run osmo-hlr_10.42.42.2(pid=17457): stderr: | [0;m[1;31m20221214114104262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114104262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114104263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114104263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114104263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114104263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114104275 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114104284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114104284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114104284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:07.443429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17446): Terminating (SIGTERM) 11:41:07.484448 run iperf3-srv_10.42.42.10(pid=17447): Terminating (SIGTERM) 11:41:07.525942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17448): Terminating (SIGTERM) 11:41:07.572122 run iperf3-srv_10.42.42.10(pid=17449): Terminating (SIGTERM) 11:41:07.615068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17450): Terminating (SIGTERM) 11:41:07.658020 run iperf3-srv_10.42.42.10(pid=17451): Terminating (SIGTERM) 11:41:07.701019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17452): Terminating (SIGTERM) 11:41:07.744014 run iperf3-srv_10.42.42.10(pid=17453): Terminating (SIGTERM) 11:41:07.787026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17456): Terminating (SIGTERM) 11:41:07.830335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17459): Terminating (SIGTERM) 11:41:07.873669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17462): Terminating (SIGTERM) 11:41:07.916740 --- ParallelTerminationStrategy: PID 17446 died... 11:41:07.937645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17446): Terminated: ok {rc=0} 11:41:07.985338 --- ParallelTerminationStrategy: PID 17447 died... 11:41:08.005613 run iperf3-srv_10.42.42.10(pid=17447): Terminated {rc=256} 11:41:08.053094 --- ParallelTerminationStrategy: PID 17448 died... 11:41:08.073688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17448): Terminated: ok {rc=0} 11:41:08.120850 --- ParallelTerminationStrategy: PID 17449 died... 11:41:08.141803 run iperf3-srv_10.42.42.10(pid=17449): Terminated {rc=256} 11:41:08.188598 --- ParallelTerminationStrategy: PID 17450 died... 11:41:08.209090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17450): Terminated: ok {rc=0} 11:41:08.256105 --- ParallelTerminationStrategy: PID 17451 died... 11:41:08.276790 run iperf3-srv_10.42.42.10(pid=17451): Terminated {rc=256} 11:41:08.323898 --- ParallelTerminationStrategy: PID 17452 died... 11:41:08.344178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17452): Terminated: ok {rc=0} 11:41:08.391320 --- ParallelTerminationStrategy: PID 17453 died... 11:41:08.411877 run iperf3-srv_10.42.42.10(pid=17453): Terminated {rc=256} 11:41:08.459298 --- ParallelTerminationStrategy: PID 17456 died... 11:41:08.479619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17456): Terminated: ok {rc=0} 11:41:08.526626 --- ParallelTerminationStrategy: PID 17459 died... 11:41:08.547075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17459): Terminated: ok {rc=0} 11:41:08.594212 --- ParallelTerminationStrategy: PID 17462 died... 11:41:08.614861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17462): Terminated: ok {rc=0} 11:41:08.705980 bus /gobi_4: Setting Powered False 11:41:09.807194 bus /gobi_4: Setting Powered False 11:41:10.925188 bus /gobi_1: Setting Powered False 11:41:12.022365 bus /gobi_1: Setting Powered False 11:41:13.137360 bus /gobi_0: Setting Powered False 11:41:14.235941 bus /gobi_0: Setting Powered False 11:41:15.351408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 11:41:16.457348 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:16.470246 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:41:16.513491 tst ping.py: using LAC 40649 11:41:16.647452 tst ping.py: using RAC 104 11:41:16.773518 tst ping.py: using CellId 40649 11:41:16.900381 tst ping.py: using BVCI 40650 11:41:17.056587 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:17.072014 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:17.084266 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:17.097185 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:17.109370 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:17.122259 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:17.136117 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:17.149479 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:41:17.269153 tst ping.py:19: start network... 11:41:17.472155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:17.938036 run create_hlr_db(pid=17464): Launched 11:41:18.055034 bus /gobi_6: Setting Powered False 11:41:19.114841 run create_hlr_db(pid=17464): Terminated: ok {rc=0} 11:41:19.555799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17466): Launched 11:41:19.880850 run osmo-hlr_10.42.42.2(pid=17467): Launched 11:41:20.002967 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:20.564273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17469): Launched 11:41:20.886877 run osmo-stp_10.42.42.5(pid=17470): Launched 11:41:21.010654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:21.565196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17472): Launched 11:41:21.688340 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:21.976926 run patchelf(pid=17473): Launched 11:41:22.157521 run osmo-stp_10.42.42.5(pid=17470): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17470)] 11:41:22.294013 run osmo-stp_10.42.42.5(pid=17470): stdout: | (launched: 2022-12-14_11:41:20.826754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:22.432159 run osmo-stp_10.42.42.5(pid=17470): stderr: | [0;m[38;5;43m20221214114121017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114121018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114121018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114121018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114121019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114121019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114121019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:22.570590 run osmo-stp_10.42.42.5(pid=17470): stdout: | (launched: 2022-12-14_11:41:20.826754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:22.702297 run osmo-stp_10.42.42.5(pid=17470): stderr: | [0;m[38;5;43m20221214114121017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114121018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114121018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114121018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114121019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114121019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114121019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:22.858568 run patchelf(pid=17473): Terminating (SIGINT) 11:41:23.039342 run patchelf(pid=17473): Terminated: ok {rc=0} 11:41:23.169313 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17470): Process ended prematurely: osmo-stp_10.42.42.5(pid=17470) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17470)] [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 11:41:23.178991 tst ping.py:22: Test FAILED (6.7 sec) 11:41:23.207327 run osmo-hlr_10.42.42.2(pid=17467): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17467)] 11:41:23.257837 run osmo-hlr_10.42.42.2(pid=17467): stdout: | (launched: 2022-12-14_11:41:19.820708) 11:41:23.309943 run osmo-hlr_10.42.42.2(pid=17467): stderr: | [0;m[1;31m20221214114120020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114120020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114120020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114120020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114120020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114120020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114120032 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114120040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114120040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114120040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:23.362614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17466): Terminating (SIGTERM) 11:41:23.404982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17469): Terminating (SIGTERM) 11:41:23.447857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17472): Terminating (SIGTERM) 11:41:23.490609 --- ParallelTerminationStrategy: PID 17466 died... 11:41:23.511053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17466): Terminated: ok {rc=0} 11:41:23.557818 --- ParallelTerminationStrategy: PID 17469 died... 11:41:23.578021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17469): Terminated: ok {rc=0} 11:41:23.624416 --- ParallelTerminationStrategy: PID 17472 died... 11:41:23.644552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17472): Terminated: ok {rc=0} 11:41:23.734166 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:41:24.821430 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:24.833841 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:41:24.873040 tst ping_idle_ping.py: using LAC 40650 11:41:25.001237 tst ping_idle_ping.py: using RAC 105 11:41:25.119965 tst ping_idle_ping.py: using CellId 40650 11:41:25.238799 tst ping_idle_ping.py: using BVCI 40651 11:41:25.349303 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:25.360107 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:25.371040 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:25.381924 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:25.392619 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:25.403455 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:25.414490 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:25.425513 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:41:25.542661 tst ping_idle_ping.py:24: start network... 11:41:25.744492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:26.214423 run create_hlr_db(pid=17474): Launched 11:41:26.331256 bus /gobi_6: Setting Powered False 11:41:27.391323 run create_hlr_db(pid=17474): Terminated: ok {rc=0} 11:41:27.837520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17476): Launched 11:41:28.164783 run osmo-hlr_10.42.42.2(pid=17477): Launched 11:41:28.289870 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:28.849750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17479): Launched 11:41:29.175350 run osmo-stp_10.42.42.5(pid=17480): Launched 11:41:29.298737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:29.857176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17482): Launched 11:41:29.982480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:30.255618 run patchelf(pid=17483): Launched 11:41:30.436150 run osmo-stp_10.42.42.5(pid=17480): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17480)] 11:41:30.572692 run osmo-stp_10.42.42.5(pid=17480): stdout: | (launched: 2022-12-14_11:41:29.115377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:30.711160 run osmo-stp_10.42.42.5(pid=17480): stderr: | [0;m[38;5;43m20221214114129307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114129308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114129308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114129308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114129309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114129309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114129309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:30.872318 run osmo-stp_10.42.42.5(pid=17480): stdout: | (launched: 2022-12-14_11:41:29.115377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:31.014349 run osmo-stp_10.42.42.5(pid=17480): stderr: | [0;m[38;5;43m20221214114129307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114129308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114129308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114129308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114129309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114129309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114129309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:31.168468 run patchelf(pid=17483): Terminating (SIGINT) 11:41:31.349984 run patchelf(pid=17483): Terminated: ok {rc=0} 11:41:31.478671 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17480): Process ended prematurely: osmo-stp_10.42.42.5(pid=17480) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17480)] [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 11:41:31.488985 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:41:31.518148 run osmo-hlr_10.42.42.2(pid=17477): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17477)] 11:41:31.571975 run osmo-hlr_10.42.42.2(pid=17477): stdout: | (launched: 2022-12-14_11:41:28.104293) 11:41:31.626638 run osmo-hlr_10.42.42.2(pid=17477): stderr: | [0;m[1;31m20221214114128302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114128302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114128302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114128303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114128303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114128303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114128318 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114128328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114128328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114128328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:31.681408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17476): Terminating (SIGTERM) 11:41:31.724698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17479): Terminating (SIGTERM) 11:41:31.771466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17482): Terminating (SIGTERM) 11:41:31.817944 --- ParallelTerminationStrategy: PID 17476 died... 11:41:31.840069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17476): Terminated: ok {rc=0} 11:41:31.889637 --- ParallelTerminationStrategy: PID 17479 died... 11:41:31.910738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17479): Terminated: ok {rc=0} 11:41:31.959348 --- ParallelTerminationStrategy: PID 17482 died... 11:41:31.980515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17482): Terminated: ok {rc=0} 11:41:32.074898 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:41:33.381604 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:41:33.388095 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:41:33.409388 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:41:33.448819 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:41:33.541067 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:41:33.562813 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:41:33.601921 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:41:34.194866 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:41:34.247514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:34.258803 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:41:34.314870 tst cs_paging_gprs_active.py: using LAC 40651 11:41:34.442861 tst cs_paging_gprs_active.py: using RAC 106 11:41:34.570833 tst cs_paging_gprs_active.py: using CellId 40651 11:41:34.697467 tst cs_paging_gprs_active.py: using BVCI 40652 11:41:34.818668 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:34.830136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:34.841603 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:34.852681 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:34.863747 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:34.874864 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:34.886285 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:34.897366 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:34.908539 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:35.027376 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:35.148542 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:41:35.371205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:35.703246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17487): Launched 11:41:35.994130 run iperf3-srv_10.42.42.10(pid=17488): Launched 11:41:36.119408 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:41:36.341642 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:36.673923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17489): Launched 11:41:36.964299 run iperf3-srv_10.42.42.10(pid=17490): Launched 11:41:37.088128 tst cs_paging_gprs_active.py:38: start network... 11:41:37.310908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:37.823231 run create_hlr_db(pid=17491): Launched 11:41:37.959731 bus /gobi_6: Setting Powered False 11:41:39.025138 run create_hlr_db(pid=17491): Terminated: ok {rc=0} 11:41:39.466331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17493): Launched 11:41:39.775947 run osmo-hlr_10.42.42.2(pid=17494): Launched 11:41:39.893392 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:40.424020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17496): Launched 11:41:40.733009 run osmo-stp_10.42.42.5(pid=17497): Launched 11:41:40.851499 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:41.384428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17499): Launched 11:41:41.503211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:41.764776 run patchelf(pid=17500): Launched 11:41:41.937428 run osmo-stp_10.42.42.5(pid=17497): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17497)] 11:41:42.068776 run osmo-stp_10.42.42.5(pid=17497): stdout: | (launched: 2022-12-14_11:41:40.675781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:42.201929 run osmo-stp_10.42.42.5(pid=17497): stderr: | [0;m[38;5;43m20221214114140845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114140845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114140845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114140846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114140846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114140846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114140846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:42.335048 run osmo-stp_10.42.42.5(pid=17497): stdout: | (launched: 2022-12-14_11:41:40.675781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:42.461682 run osmo-stp_10.42.42.5(pid=17497): stderr: | [0;m[38;5;43m20221214114140845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114140845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114140845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114140846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114140846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114140846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114140846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:42.611790 run patchelf(pid=17500): Terminating (SIGINT) 11:41:42.785297 run patchelf(pid=17500): Terminated: ok {rc=0} 11:41:42.910686 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17497): Process ended prematurely: osmo-stp_10.42.42.5(pid=17497) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17497)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:41:42.920041 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:41:42.947317 run osmo-hlr_10.42.42.2(pid=17494): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17494)] 11:41:42.996129 run osmo-hlr_10.42.42.2(pid=17494): stdout: | (launched: 2022-12-14_11:41:39.718806) 11:41:43.046081 run osmo-hlr_10.42.42.2(pid=17494): stderr: | [0;m[1;31m20221214114139897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114139897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114139897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114139897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114139897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114139897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114139908 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114139917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114139917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114139917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:43.096592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17487): Terminating (SIGTERM) 11:41:43.137751 run iperf3-srv_10.42.42.10(pid=17488): Terminating (SIGTERM) 11:41:43.178381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17489): Terminating (SIGTERM) 11:41:43.218803 run iperf3-srv_10.42.42.10(pid=17490): Terminating (SIGTERM) 11:41:43.259002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17493): Terminating (SIGTERM) 11:41:43.299635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17496): Terminating (SIGTERM) 11:41:43.340222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17499): Terminating (SIGTERM) 11:41:43.380776 --- ParallelTerminationStrategy: PID 17487 died... 11:41:43.400332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17487): Terminated: ok {rc=0} 11:41:43.445223 --- ParallelTerminationStrategy: PID 17488 died... 11:41:43.464120 run iperf3-srv_10.42.42.10(pid=17488): Terminated {rc=256} 11:41:43.508531 --- ParallelTerminationStrategy: PID 17489 died... 11:41:43.527553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17489): Terminated: ok {rc=0} 11:41:43.571719 --- ParallelTerminationStrategy: PID 17490 died... 11:41:43.590613 run iperf3-srv_10.42.42.10(pid=17490): Terminated {rc=256} 11:41:43.634913 --- ParallelTerminationStrategy: PID 17493 died... 11:41:43.654022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17493): Terminated: ok {rc=0} 11:41:43.698792 --- ParallelTerminationStrategy: PID 17496 died... 11:41:43.717857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17496): Terminated: ok {rc=0} 11:41:43.762321 --- ParallelTerminationStrategy: PID 17499 died... 11:41:43.781463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17499): Terminated: ok {rc=0} 11:41:43.868746 bus /gobi_0: Setting Powered False 11:41:44.969200 bus /gobi_0: Setting Powered False 11:41:46.081858 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:41:47.228178 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:47.240610 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:41:47.301398 tst iperf3.py: using LAC 40652 11:41:47.421363 tst iperf3.py: using RAC 107 11:41:47.542102 tst iperf3.py: using CellId 40652 11:41:47.662597 tst iperf3.py: using BVCI 40653 11:41:47.775882 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:47.786740 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:47.797410 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:47.807972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:47.818853 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:47.829833 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:47.841151 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:47.852411 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:47.863540 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:47.985621 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:41:48.206957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:48.536811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17502): Launched 11:41:48.825560 run iperf3-srv_10.42.42.10(pid=17503): Launched 11:41:48.949406 tst iperf3.py:8: start network... 11:41:49.171037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:49.680753 run create_hlr_db(pid=17504): Launched 11:41:49.815513 bus /gobi_6: Setting Powered False 11:41:50.880360 run create_hlr_db(pid=17504): Terminated: ok {rc=0} 11:41:51.319698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17506): Launched 11:41:51.629172 run osmo-hlr_10.42.42.2(pid=17507): Launched 11:41:51.746618 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:52.289634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17509): Launched 11:41:52.597483 run osmo-stp_10.42.42.5(pid=17510): Launched 11:41:52.714637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:53.245176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17512): Launched 11:41:53.363046 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:53.623111 run patchelf(pid=17513): Launched 11:41:53.794281 run osmo-stp_10.42.42.5(pid=17510): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17510)] 11:41:53.925201 run osmo-stp_10.42.42.5(pid=17510): stdout: | (launched: 2022-12-14_11:41:52.540131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:54.057491 run osmo-stp_10.42.42.5(pid=17510): stderr: | [0;m[38;5;43m20221214114152712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114152712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114152712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114152713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114152713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114152713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114152713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:54.189900 run osmo-stp_10.42.42.5(pid=17510): stdout: | (launched: 2022-12-14_11:41:52.540131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:54.316053 run osmo-stp_10.42.42.5(pid=17510): stderr: | [0;m[38;5;43m20221214114152712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114152712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114152712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114152713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114152713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114152713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114152713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:54.466095 run patchelf(pid=17513): Terminating (SIGINT) 11:41:54.638779 run patchelf(pid=17513): Terminated: ok {rc=0} 11:41:54.763302 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17510): Process ended prematurely: osmo-stp_10.42.42.5(pid=17510) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17510)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 11:41:54.772816 tst iperf3.py:8: Test FAILED (7.6 sec) 11:41:54.800164 run osmo-hlr_10.42.42.2(pid=17507): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17507)] 11:41:54.849150 run osmo-hlr_10.42.42.2(pid=17507): stdout: | (launched: 2022-12-14_11:41:51.571960) 11:41:54.899816 run osmo-hlr_10.42.42.2(pid=17507): stderr: | [0;m[1;31m20221214114151748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114151748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114151748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114151748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114151749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114151749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114151760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114151768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114151768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114151768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:54.950757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17502): Terminating (SIGTERM) 11:41:54.991598 run iperf3-srv_10.42.42.10(pid=17503): Terminating (SIGTERM) 11:41:55.032383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17506): Terminating (SIGTERM) 11:41:55.073087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17509): Terminating (SIGTERM) 11:41:55.114354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17512): Terminating (SIGTERM) 11:41:55.155324 --- ParallelTerminationStrategy: PID 17502 died... 11:41:55.174879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17502): Terminated: ok {rc=0} 11:41:55.219934 --- ParallelTerminationStrategy: PID 17503 died... 11:41:55.239019 run iperf3-srv_10.42.42.10(pid=17503): Terminated {rc=256} 11:41:55.283564 --- ParallelTerminationStrategy: PID 17506 died... 11:41:55.302764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17506): Terminated: ok {rc=0} 11:41:55.347297 --- ParallelTerminationStrategy: PID 17509 died... 11:41:55.366528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17509): Terminated: ok {rc=0} 11:41:55.410994 --- ParallelTerminationStrategy: PID 17512 died... 11:41:55.430175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17512): Terminated: ok {rc=0} 11:41:55.517442 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:41:56.666088 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:56.677775 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:41:56.734609 tst iperf3m4.py: using LAC 40653 11:41:56.855470 tst iperf3m4.py: using RAC 108 11:41:56.985615 tst iperf3m4.py: using CellId 40653 11:41:57.114014 tst iperf3m4.py: using BVCI 40654 11:41:57.233899 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:57.245480 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:57.256579 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:57.267838 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:57.279363 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:57.290870 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:57.302756 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:57.314307 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:41:57.326107 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:57.446534 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:57.570397 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:57.690297 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:41:57.811782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:41:58.034574 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:58.365492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17514): Launched 11:41:58.652909 run iperf3-srv_10.42.42.10(pid=17515): Launched 11:41:58.777851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:41:58.998818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:59.329448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17516): Launched 11:41:59.600064 run iperf3-srv_10.42.42.10(pid=17517): Launched 11:41:59.715987 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:41:59.920694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:00.231302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17518): Launched 11:42:00.502580 run iperf3-srv_10.42.42.10(pid=17519): Launched 11:42:00.618101 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:42:00.822401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:01.285696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17524): Launched 11:42:01.571067 run iperf3-srv_10.42.42.10(pid=17525): Launched 11:42:01.704010 tst iperf3m4.py:8: start network... 11:42:01.916875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:02.407557 run create_hlr_db(pid=17526): Launched 11:42:02.526658 bus /gobi_6: Setting Powered False 11:42:03.587813 run create_hlr_db(pid=17526): Terminated: ok {rc=0} 11:42:04.038068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17528): Launched 11:42:04.371094 run osmo-hlr_10.42.42.2(pid=17529): Launched 11:42:04.497270 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:05.065220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17531): Launched 11:42:05.395323 run osmo-stp_10.42.42.5(pid=17532): Launched 11:42:05.520922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:06.089131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17534): Launched 11:42:06.215835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:06.494114 run patchelf(pid=17535): Launched 11:42:06.677791 run osmo-stp_10.42.42.5(pid=17532): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17532)] 11:42:06.816330 run osmo-stp_10.42.42.5(pid=17532): stdout: | (launched: 2022-12-14_11:42:05.334759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:06.956621 run osmo-stp_10.42.42.5(pid=17532): stderr: | [0;m[38;5;43m20221214114205522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114205522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114205523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114205523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114205524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114205524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114205524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:07.097134 run osmo-stp_10.42.42.5(pid=17532): stdout: | (launched: 2022-12-14_11:42:05.334759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:07.231466 run osmo-stp_10.42.42.5(pid=17532): stderr: | [0;m[38;5;43m20221214114205522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114205522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114205523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114205523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114205524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114205524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114205524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:07.390875 run patchelf(pid=17535): Terminating (SIGINT) 11:42:07.574869 run patchelf(pid=17535): Terminated: ok {rc=0} 11:42:07.706976 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17532): Process ended prematurely: osmo-stp_10.42.42.5(pid=17532) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17532)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:42:07.717185 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:42:07.746241 run osmo-hlr_10.42.42.2(pid=17529): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17529)] 11:42:07.796573 run osmo-hlr_10.42.42.2(pid=17529): stdout: | (launched: 2022-12-14_11:42:04.310108) 11:42:07.849063 run osmo-hlr_10.42.42.2(pid=17529): stderr: | [0;m[1;31m20221214114204505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114204505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114204505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114204505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114204505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114204505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114204517 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114204526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114204527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114204527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:07.901470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17514): Terminating (SIGTERM) 11:42:07.943559 run iperf3-srv_10.42.42.10(pid=17515): Terminating (SIGTERM) 11:42:07.985657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17516): Terminating (SIGTERM) 11:42:08.028393 run iperf3-srv_10.42.42.10(pid=17517): Terminating (SIGTERM) 11:42:08.070961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17518): Terminating (SIGTERM) 11:42:08.113592 run iperf3-srv_10.42.42.10(pid=17519): Terminating (SIGTERM) 11:42:08.156023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17524): Terminating (SIGTERM) 11:42:08.198924 run iperf3-srv_10.42.42.10(pid=17525): Terminating (SIGTERM) 11:42:08.241244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17528): Terminating (SIGTERM) 11:42:08.284064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17531): Terminating (SIGTERM) 11:42:08.326229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17534): Terminating (SIGTERM) 11:42:08.369223 --- ParallelTerminationStrategy: PID 17514 died... 11:42:08.389412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17514): Terminated: ok {rc=0} 11:42:08.436091 --- ParallelTerminationStrategy: PID 17515 died... 11:42:08.455969 run iperf3-srv_10.42.42.10(pid=17515): Terminated {rc=256} 11:42:08.502367 --- ParallelTerminationStrategy: PID 17516 died... 11:42:08.522166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17516): Terminated: ok {rc=0} 11:42:08.568680 --- ParallelTerminationStrategy: PID 17517 died... 11:42:08.588647 run iperf3-srv_10.42.42.10(pid=17517): Terminated {rc=256} 11:42:08.635111 --- ParallelTerminationStrategy: PID 17518 died... 11:42:08.654938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17518): Terminated: ok {rc=0} 11:42:08.701256 --- ParallelTerminationStrategy: PID 17519 died... 11:42:08.720819 run iperf3-srv_10.42.42.10(pid=17519): Terminated {rc=256} 11:42:08.767217 --- ParallelTerminationStrategy: PID 17524 died... 11:42:08.786791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17524): Terminated: ok {rc=0} 11:42:08.833080 --- ParallelTerminationStrategy: PID 17525 died... 11:42:08.853259 run iperf3-srv_10.42.42.10(pid=17525): Terminated {rc=256} 11:42:08.899789 --- ParallelTerminationStrategy: PID 17528 died... 11:42:08.919554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17528): Terminated: ok {rc=0} 11:42:08.966324 --- ParallelTerminationStrategy: PID 17531 died... 11:42:08.985973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17531): Terminated: ok {rc=0} 11:42:09.031752 --- ParallelTerminationStrategy: PID 17534 died... 11:42:09.051309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17534): Terminated: ok {rc=0} 11:42:09.139379 bus /gobi_4: Setting Powered False 11:42:10.239178 bus /gobi_4: Setting Powered False 11:42:11.355044 bus /gobi_1: Setting Powered False 11:42:12.453833 bus /gobi_1: Setting Powered False 11:42:13.570671 bus /gobi_0: Setting Powered False 11:42:14.668744 bus /gobi_0: Setting Powered False 11:42:15.788110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:42:16.903314 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:16.915676 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:42:16.976516 tst ping.py: using LAC 40654 11:42:17.145287 tst ping.py: using RAC 109 11:42:17.264678 tst ping.py: using CellId 40654 11:42:17.386141 tst ping.py: using BVCI 40655 11:42:17.497780 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:17.508574 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:17.519252 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:17.530008 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:17.541531 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:17.552086 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:17.563003 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:17.573576 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:42:17.692784 tst ping.py:19: start network... 11:42:17.894238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:18.359798 run create_hlr_db(pid=17536): Launched 11:42:18.489695 bus /gobi_6: Setting Powered False 11:42:19.553663 run create_hlr_db(pid=17536): Terminated: ok {rc=0} 11:42:20.005840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17538): Launched 11:42:20.331048 run osmo-hlr_10.42.42.2(pid=17539): Launched 11:42:20.453332 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:21.011659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17541): Launched 11:42:21.336729 run osmo-stp_10.42.42.5(pid=17542): Launched 11:42:21.459884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:22.018625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17544): Launched 11:42:22.142001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:22.415346 run patchelf(pid=17545): Launched 11:42:22.595823 run osmo-stp_10.42.42.5(pid=17542): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17542)] 11:42:22.732718 run osmo-stp_10.42.42.5(pid=17542): stdout: | (launched: 2022-12-14_11:42:21.275831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:22.871967 run osmo-stp_10.42.42.5(pid=17542): stderr: | [0;m[38;5;43m20221214114221467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114221467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114221467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114221468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114221468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114221468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114221468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:23.011103 run osmo-stp_10.42.42.5(pid=17542): stdout: | (launched: 2022-12-14_11:42:21.275831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:23.143595 run osmo-stp_10.42.42.5(pid=17542): stderr: | [0;m[38;5;43m20221214114221467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114221467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114221467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114221468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114221468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114221468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114221468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:23.300048 run patchelf(pid=17545): Terminating (SIGINT) 11:42:23.481807 run patchelf(pid=17545): Terminated: ok {rc=0} 11:42:23.612070 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17542): Process ended prematurely: osmo-stp_10.42.42.5(pid=17542) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17542)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 11:42:23.622024 tst ping.py:22: Test FAILED (6.7 sec) 11:42:23.650183 run osmo-hlr_10.42.42.2(pid=17539): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17539)] 11:42:23.700695 run osmo-hlr_10.42.42.2(pid=17539): stdout: | (launched: 2022-12-14_11:42:20.271204) 11:42:23.753101 run osmo-hlr_10.42.42.2(pid=17539): stderr: | [0;m[1;31m20221214114220468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114220468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114220468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114220468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114220468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114220468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114220481 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114220489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114220489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114220489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:23.805589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17538): Terminating (SIGTERM) 11:42:23.848104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17541): Terminating (SIGTERM) 11:42:23.891040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17544): Terminating (SIGTERM) 11:42:23.933870 --- ParallelTerminationStrategy: PID 17538 died... 11:42:23.954101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17538): Terminated: ok {rc=0} 11:42:24.000709 --- ParallelTerminationStrategy: PID 17541 died... 11:42:24.020581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17541): Terminated: ok {rc=0} 11:42:24.067135 --- ParallelTerminationStrategy: PID 17544 died... 11:42:24.087071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17544): Terminated: ok {rc=0} 11:42:24.176183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:42:25.265530 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:25.278235 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:42:25.337853 tst ping_idle_ping.py: using LAC 40655 11:42:25.470339 tst ping_idle_ping.py: using RAC 110 11:42:25.595669 tst ping_idle_ping.py: using CellId 40655 11:42:25.714941 tst ping_idle_ping.py: using BVCI 40656 11:42:25.827297 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:25.838351 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:25.849332 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:25.860021 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:25.871057 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:25.882179 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:25.893463 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:25.904454 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:42:26.021115 tst ping_idle_ping.py:24: start network... 11:42:26.225063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:26.697713 run create_hlr_db(pid=17546): Launched 11:42:26.813356 bus /gobi_6: Setting Powered False 11:42:27.874201 run create_hlr_db(pid=17546): Terminated: ok {rc=0} 11:42:28.322108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17548): Launched 11:42:28.648472 run osmo-hlr_10.42.42.2(pid=17549): Launched 11:42:28.774030 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:29.335976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17551): Launched 11:42:29.661677 run osmo-stp_10.42.42.5(pid=17552): Launched 11:42:29.784406 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:30.346375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17554): Launched 11:42:30.471445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:30.745984 run patchelf(pid=17555): Launched 11:42:30.932156 run osmo-stp_10.42.42.5(pid=17552): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17552)] 11:42:31.065298 run osmo-stp_10.42.42.5(pid=17552): stdout: | (launched: 2022-12-14_11:42:29.601507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:31.201616 run osmo-stp_10.42.42.5(pid=17552): stderr: | [0;m[38;5;43m20221214114229793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114229793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114229793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114229794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114229794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114229794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114229794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:31.338560 run osmo-stp_10.42.42.5(pid=17552): stdout: | (launched: 2022-12-14_11:42:29.601507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:31.466345 run osmo-stp_10.42.42.5(pid=17552): stderr: | [0;m[38;5;43m20221214114229793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114229793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114229793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114229794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114229794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114229794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114229794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:31.619644 run patchelf(pid=17555): Terminating (SIGINT) 11:42:31.848928 run patchelf(pid=17555): Terminated: ok {rc=0} 11:42:32.005361 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17552): Process ended prematurely: osmo-stp_10.42.42.5(pid=17552) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17552)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:42:32.015852 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:42:32.044037 run osmo-hlr_10.42.42.2(pid=17549): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17549)] 11:42:32.096422 run osmo-hlr_10.42.42.2(pid=17549): stdout: | (launched: 2022-12-14_11:42:28.588533) 11:42:32.150576 run osmo-hlr_10.42.42.2(pid=17549): stderr: | [0;m[1;31m20221214114228786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114228786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114228786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114228786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114228787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114228787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114228799 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114228807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114228808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114228808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:32.203383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17548): Terminating (SIGTERM) 11:42:32.245610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17551): Terminating (SIGTERM) 11:42:32.290040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17554): Terminating (SIGTERM) 11:42:32.335788 --- ParallelTerminationStrategy: PID 17548 died... 11:42:32.356524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17548): Terminated: ok {rc=0} 11:42:32.404334 --- ParallelTerminationStrategy: PID 17551 died... 11:42:32.424306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17551): Terminated: ok {rc=0} 11:42:32.471073 --- ParallelTerminationStrategy: PID 17554 died... 11:42:32.490990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17554): Terminated: ok {rc=0} 11:42:32.579970 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:42:33.873296 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:42:33.879404 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:42:33.899680 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:42:33.938564 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:42:34.024546 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:42:34.044735 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:42:34.082969 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:42:34.676139 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:42:34.725655 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:34.736398 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:42:34.796482 tst cs_paging_gprs_active.py: using LAC 40656 11:42:34.915703 tst cs_paging_gprs_active.py: using RAC 111 11:42:35.034049 tst cs_paging_gprs_active.py: using CellId 40656 11:42:35.154293 tst cs_paging_gprs_active.py: using BVCI 40657 11:42:35.267473 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:35.278455 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:35.289077 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:35.299557 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:35.310398 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:35.321931 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:35.332831 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:35.343670 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:35.354722 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:35.477335 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:35.599742 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:42:35.822734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:36.154685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17559): Launched 11:42:36.444094 run iperf3-srv_10.42.42.10(pid=17560): Launched 11:42:36.571016 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:42:36.794025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:37.127432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17561): Launched 11:42:37.417023 run iperf3-srv_10.42.42.10(pid=17562): Launched 11:42:37.543167 tst cs_paging_gprs_active.py:38: start network... 11:42:37.765252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:38.278985 run create_hlr_db(pid=17563): Launched 11:42:38.412676 bus /gobi_6: Setting Powered False 11:42:39.477548 run create_hlr_db(pid=17563): Terminated: ok {rc=0} 11:42:39.919824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17565): Launched 11:42:40.253337 run osmo-hlr_10.42.42.2(pid=17566): Launched 11:42:40.382121 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:40.953825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17568): Launched 11:42:41.284463 run osmo-stp_10.42.42.5(pid=17569): Launched 11:42:41.411152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:41.982058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17571): Launched 11:42:42.108010 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:42.387566 run patchelf(pid=17572): Launched 11:42:42.572033 run osmo-stp_10.42.42.5(pid=17569): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17569)] 11:42:42.711298 run osmo-stp_10.42.42.5(pid=17569): stdout: | (launched: 2022-12-14_11:42:41.223476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:42.852718 run osmo-stp_10.42.42.5(pid=17569): stderr: | [0;m[38;5;43m20221214114241418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114241418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114241418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114241419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114241419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114241419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114241419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:42.994486 run osmo-stp_10.42.42.5(pid=17569): stdout: | (launched: 2022-12-14_11:42:41.223476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:43.129663 run osmo-stp_10.42.42.5(pid=17569): stderr: | [0;m[38;5;43m20221214114241418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114241418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114241418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114241419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114241419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114241419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114241419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:43.289442 run patchelf(pid=17572): Terminating (SIGINT) 11:42:43.474026 run patchelf(pid=17572): Terminated: ok {rc=0} 11:42:43.606981 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17569): Process ended prematurely: osmo-stp_10.42.42.5(pid=17569) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17569)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:42:43.617315 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:42:43.645637 run osmo-hlr_10.42.42.2(pid=17566): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17566)] 11:42:43.695752 run osmo-hlr_10.42.42.2(pid=17566): stdout: | (launched: 2022-12-14_11:42:40.191632) 11:42:43.747364 run osmo-hlr_10.42.42.2(pid=17566): stderr: | [0;m[1;31m20221214114240391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114240391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114240391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114240391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114240391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114240391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114240404 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114240414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114240415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114240415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:43.799422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17559): Terminating (SIGTERM) 11:42:43.841228 run iperf3-srv_10.42.42.10(pid=17560): Terminating (SIGTERM) 11:42:43.883993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17561): Terminating (SIGTERM) 11:42:43.926068 run iperf3-srv_10.42.42.10(pid=17562): Terminating (SIGTERM) 11:42:43.968326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17565): Terminating (SIGTERM) 11:42:44.010267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17568): Terminating (SIGTERM) 11:42:44.052570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17571): Terminating (SIGTERM) 11:42:44.094545 --- ParallelTerminationStrategy: PID 17559 died... 11:42:44.114463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17559): Terminated: ok {rc=0} 11:42:44.160656 --- ParallelTerminationStrategy: PID 17560 died... 11:42:44.180028 run iperf3-srv_10.42.42.10(pid=17560): Terminated {rc=256} 11:42:44.225931 --- ParallelTerminationStrategy: PID 17561 died... 11:42:44.245352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17561): Terminated: ok {rc=0} 11:42:44.291194 --- ParallelTerminationStrategy: PID 17562 died... 11:42:44.310931 run iperf3-srv_10.42.42.10(pid=17562): Terminated {rc=256} 11:42:44.357209 --- ParallelTerminationStrategy: PID 17565 died... 11:42:44.376622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17565): Terminated: ok {rc=0} 11:42:44.422798 --- ParallelTerminationStrategy: PID 17568 died... 11:42:44.442695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17568): Terminated: ok {rc=0} 11:42:44.488574 --- ParallelTerminationStrategy: PID 17571 died... 11:42:44.508113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17571): Terminated: ok {rc=0} 11:42:44.595817 bus /gobi_0: Setting Powered False 11:42:45.693979 bus /gobi_0: Setting Powered False 11:42:46.822714 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:42:47.979663 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:47.991374 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:42:48.051395 tst iperf3.py: using LAC 40657 11:42:48.174264 tst iperf3.py: using RAC 112 11:42:48.294133 tst iperf3.py: using CellId 40657 11:42:48.416881 tst iperf3.py: using BVCI 40658 11:42:48.529175 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:48.540186 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:48.550834 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:48.561602 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:48.572308 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:48.583234 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:48.594381 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:48.605264 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:48.616121 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:48.738640 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:42:48.961156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:49.291377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17573): Launched 11:42:49.579966 run iperf3-srv_10.42.42.10(pid=17574): Launched 11:42:49.704707 tst iperf3.py:8: start network... 11:42:49.926420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:50.437588 run create_hlr_db(pid=17575): Launched 11:42:50.571943 bus /gobi_6: Setting Powered False 11:42:51.637630 run create_hlr_db(pid=17575): Terminated: ok {rc=0} 11:42:52.078216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17577): Launched 11:42:52.389045 run osmo-hlr_10.42.42.2(pid=17578): Launched 11:42:52.506535 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:53.037493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17580): Launched 11:42:53.345048 run osmo-stp_10.42.42.5(pid=17581): Launched 11:42:53.462828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:53.994193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17583): Launched 11:42:54.113919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:54.374766 run patchelf(pid=17584): Launched 11:42:54.548646 run osmo-stp_10.42.42.5(pid=17581): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17581)] 11:42:54.679602 run osmo-stp_10.42.42.5(pid=17581): stdout: | (launched: 2022-12-14_11:42:53.287887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:54.812042 run osmo-stp_10.42.42.5(pid=17581): stderr: | [0;m[38;5;43m20221214114253458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114253458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114253458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114253458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114253459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114253459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114253459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:54.944828 run osmo-stp_10.42.42.5(pid=17581): stdout: | (launched: 2022-12-14_11:42:53.287887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:55.070957 run osmo-stp_10.42.42.5(pid=17581): stderr: | [0;m[38;5;43m20221214114253458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114253458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114253458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114253458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114253459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114253459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114253459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:55.220281 run patchelf(pid=17584): Terminating (SIGINT) 11:42:55.393233 run patchelf(pid=17584): Terminated: ok {rc=0} 11:42:55.517852 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17581): Process ended prematurely: osmo-stp_10.42.42.5(pid=17581) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17581)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 11:42:55.527453 tst iperf3.py:8: Test FAILED (7.6 sec) 11:42:55.554170 run osmo-hlr_10.42.42.2(pid=17578): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17578)] 11:42:55.602783 run osmo-hlr_10.42.42.2(pid=17578): stdout: | (launched: 2022-12-14_11:42:52.331249) 11:42:55.653105 run osmo-hlr_10.42.42.2(pid=17578): stderr: | [0;m[1;31m20221214114252509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114252509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114252509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114252509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114252509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114252509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114252521 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114252529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114252530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114252531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:55.703540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17573): Terminating (SIGTERM) 11:42:55.744171 run iperf3-srv_10.42.42.10(pid=17574): Terminating (SIGTERM) 11:42:55.784672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17577): Terminating (SIGTERM) 11:42:55.831809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17580): Terminating (SIGTERM) 11:42:55.874741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17583): Terminating (SIGTERM) 11:42:55.917318 --- ParallelTerminationStrategy: PID 17573 died... 11:42:55.938211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17573): Terminated: ok {rc=0} 11:42:55.986099 --- ParallelTerminationStrategy: PID 17574 died... 11:42:56.006626 run iperf3-srv_10.42.42.10(pid=17574): Terminated {rc=256} 11:42:56.053564 --- ParallelTerminationStrategy: PID 17577 died... 11:42:56.073919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17577): Terminated: ok {rc=0} 11:42:56.120776 --- ParallelTerminationStrategy: PID 17580 died... 11:42:56.141072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17580): Terminated: ok {rc=0} 11:42:56.187883 --- ParallelTerminationStrategy: PID 17583 died... 11:42:56.208324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17583): Terminated: ok {rc=0} 11:42:56.298980 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:42:57.444501 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:57.455972 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:42:57.513119 tst iperf3m4.py: using LAC 40658 11:42:57.634626 tst iperf3m4.py: using RAC 113 11:42:57.756733 tst iperf3m4.py: using CellId 40658 11:42:57.876103 tst iperf3m4.py: using BVCI 40659 11:42:57.989247 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:58.000127 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:58.010735 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:58.021440 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:58.031947 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:58.043338 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:58.054344 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:58.065611 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:42:58.076679 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:58.200279 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:58.321725 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:58.442413 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:42:58.565281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:42:58.788615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:59.122023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17585): Launched 11:42:59.411859 run iperf3-srv_10.42.42.10(pid=17586): Launched 11:42:59.537826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:42:59.759005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:00.090052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17587): Launched 11:43:00.379508 run iperf3-srv_10.42.42.10(pid=17588): Launched 11:43:00.504247 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:43:00.725187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:01.096658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17589): Launched 11:43:01.393762 run iperf3-srv_10.42.42.10(pid=17590): Launched 11:43:01.526032 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:43:01.740028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:02.061617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17591): Launched 11:43:02.354542 run iperf3-srv_10.42.42.10(pid=17592): Launched 11:43:02.478348 tst iperf3m4.py:8: start network... 11:43:02.699434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:03.210162 run create_hlr_db(pid=17593): Launched 11:43:03.344416 bus /gobi_6: Setting Powered False 11:43:04.408139 run create_hlr_db(pid=17593): Terminated: ok {rc=0} 11:43:04.847023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17595): Launched 11:43:05.155269 run osmo-hlr_10.42.42.2(pid=17596): Launched 11:43:05.273843 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:05.807405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17598): Launched 11:43:06.116291 run osmo-stp_10.42.42.5(pid=17599): Launched 11:43:06.234427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:06.765339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17601): Launched 11:43:06.885375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:07.145450 run patchelf(pid=17602): Launched 11:43:07.318355 run osmo-stp_10.42.42.5(pid=17599): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17599)] 11:43:07.448820 run osmo-stp_10.42.42.5(pid=17599): stdout: | (launched: 2022-12-14_11:43:06.058829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:07.580830 run osmo-stp_10.42.42.5(pid=17599): stderr: | [0;m[38;5;43m20221214114306227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114306228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114306228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114306228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114306229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114306229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114306229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:07.713175 run osmo-stp_10.42.42.5(pid=17599): stdout: | (launched: 2022-12-14_11:43:06.058829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:07.838947 run osmo-stp_10.42.42.5(pid=17599): stderr: | [0;m[38;5;43m20221214114306227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114306228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114306228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114306228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114306229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114306229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114306229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:07.988315 run patchelf(pid=17602): Terminating (SIGINT) 11:43:08.160755 run patchelf(pid=17602): Terminated: ok {rc=0} 11:43:08.285328 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17599): Process ended prematurely: osmo-stp_10.42.42.5(pid=17599) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17599)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:43:08.294926 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:43:08.322726 run osmo-hlr_10.42.42.2(pid=17596): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17596)] 11:43:08.371639 run osmo-hlr_10.42.42.2(pid=17596): stdout: | (launched: 2022-12-14_11:43:05.097998) 11:43:08.421797 run osmo-hlr_10.42.42.2(pid=17596): stderr: | [0;m[1;31m20221214114305270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114305270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114305270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114305270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114305270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114305270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114305282 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114305290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114305290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114305290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:08.472237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17585): Terminating (SIGTERM) 11:43:08.513530 run iperf3-srv_10.42.42.10(pid=17586): Terminating (SIGTERM) 11:43:08.553969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17587): Terminating (SIGTERM) 11:43:08.594424 run iperf3-srv_10.42.42.10(pid=17588): Terminating (SIGTERM) 11:43:08.634748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17589): Terminating (SIGTERM) 11:43:08.675212 run iperf3-srv_10.42.42.10(pid=17590): Terminating (SIGTERM) 11:43:08.715297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17591): Terminating (SIGTERM) 11:43:08.755555 run iperf3-srv_10.42.42.10(pid=17592): Terminating (SIGTERM) 11:43:08.795697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17595): Terminating (SIGTERM) 11:43:08.836166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17598): Terminating (SIGTERM) 11:43:08.876485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17601): Terminating (SIGTERM) 11:43:08.916918 --- ParallelTerminationStrategy: PID 17585 died... 11:43:08.936486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17585): Terminated: ok {rc=0} 11:43:08.981050 --- ParallelTerminationStrategy: PID 17586 died... 11:43:09.000065 run iperf3-srv_10.42.42.10(pid=17586): Terminated {rc=256} 11:43:09.044096 --- ParallelTerminationStrategy: PID 17587 died... 11:43:09.063076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17587): Terminated: ok {rc=0} 11:43:09.107618 --- ParallelTerminationStrategy: PID 17588 died... 11:43:09.126515 run iperf3-srv_10.42.42.10(pid=17588): Terminated {rc=256} 11:43:09.170342 --- ParallelTerminationStrategy: PID 17589 died... 11:43:09.189240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17589): Terminated: ok {rc=0} 11:43:09.233675 --- ParallelTerminationStrategy: PID 17590 died... 11:43:09.252598 run iperf3-srv_10.42.42.10(pid=17590): Terminated {rc=256} 11:43:09.296724 --- ParallelTerminationStrategy: PID 17591 died... 11:43:09.315657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17591): Terminated: ok {rc=0} 11:43:09.360097 --- ParallelTerminationStrategy: PID 17592 died... 11:43:09.379155 run iperf3-srv_10.42.42.10(pid=17592): Terminated {rc=256} 11:43:09.423064 --- ParallelTerminationStrategy: PID 17595 died... 11:43:09.442092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17595): Terminated: ok {rc=0} 11:43:09.486309 --- ParallelTerminationStrategy: PID 17598 died... 11:43:09.505313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17598): Terminated: ok {rc=0} 11:43:09.549658 --- ParallelTerminationStrategy: PID 17601 died... 11:43:09.568817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17601): Terminated: ok {rc=0} 11:43:09.656017 bus /gobi_4: Setting Powered False 11:43:10.756574 bus /gobi_4: Setting Powered False 11:43:11.869673 bus /gobi_1: Setting Powered False 11:43:12.966600 bus /gobi_1: Setting Powered False 11:43:14.080509 bus /gobi_0: Setting Powered False 11:43:15.178128 bus /gobi_0: Setting Powered False 11:43:16.305384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:43:17.414055 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:17.425709 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:43:17.482815 tst ping.py: using LAC 40659 11:43:17.601644 tst ping.py: using RAC 114 11:43:17.729209 tst ping.py: using CellId 40659 11:43:17.858711 tst ping.py: using BVCI 40660 11:43:17.978180 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:17.989764 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:18.000885 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:18.012093 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:18.023276 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:18.034452 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:18.045811 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:18.056928 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:43:18.172668 tst ping.py:19: start network... 11:43:18.376173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:18.844323 run create_hlr_db(pid=17603): Launched 11:43:18.959353 bus /gobi_6: Setting Powered False 11:43:20.019376 run create_hlr_db(pid=17603): Terminated: ok {rc=0} 11:43:20.464396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17605): Launched 11:43:20.791003 run osmo-hlr_10.42.42.2(pid=17606): Launched 11:43:20.915979 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:21.477450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17608): Launched 11:43:21.800757 run osmo-stp_10.42.42.5(pid=17609): Launched 11:43:21.923584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:22.481323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17611): Launched 11:43:22.606071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:22.880015 run patchelf(pid=17612): Launched 11:43:23.061817 run osmo-stp_10.42.42.5(pid=17609): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17609)] 11:43:23.198560 run osmo-stp_10.42.42.5(pid=17609): stdout: | (launched: 2022-12-14_11:43:21.740879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:23.337352 run osmo-stp_10.42.42.5(pid=17609): stderr: | [0;m[38;5;43m20221214114321933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114321934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114321934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114321934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114321935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114321935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114321935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:23.475991 run osmo-stp_10.42.42.5(pid=17609): stdout: | (launched: 2022-12-14_11:43:21.740879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:23.608031 run osmo-stp_10.42.42.5(pid=17609): stderr: | [0;m[38;5;43m20221214114321933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114321934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114321934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114321934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114321935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114321935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114321935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:23.764081 run patchelf(pid=17612): Terminating (SIGINT) 11:43:23.944824 run patchelf(pid=17612): Terminated: ok {rc=0} 11:43:24.074578 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17609): Process ended prematurely: osmo-stp_10.42.42.5(pid=17609) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17609)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 11:43:24.084065 tst ping.py:22: Test FAILED (6.7 sec) 11:43:24.112211 run osmo-hlr_10.42.42.2(pid=17606): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17606)] 11:43:24.162629 run osmo-hlr_10.42.42.2(pid=17606): stdout: | (launched: 2022-12-14_11:43:20.730949) 11:43:24.214766 run osmo-hlr_10.42.42.2(pid=17606): stderr: | [0;m[1;31m20221214114320928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114320928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114320928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114320928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114320928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114320928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114320942 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114320952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114320952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114320952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:24.267308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17605): Terminating (SIGTERM) 11:43:24.310220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17608): Terminating (SIGTERM) 11:43:24.353093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17611): Terminating (SIGTERM) 11:43:24.395512 --- ParallelTerminationStrategy: PID 17605 died... 11:43:24.415737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17605): Terminated: ok {rc=0} 11:43:24.462708 --- ParallelTerminationStrategy: PID 17608 died... 11:43:24.482519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17608): Terminated: ok {rc=0} 11:43:24.529023 --- ParallelTerminationStrategy: PID 17611 died... 11:43:24.548693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17611): Terminated: ok {rc=0} 11:43:24.637431 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:43:25.725379 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:25.737228 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:43:25.795183 tst ping_idle_ping.py: using LAC 40660 11:43:25.915326 tst ping_idle_ping.py: using RAC 115 11:43:26.035295 tst ping_idle_ping.py: using CellId 40660 11:43:26.155460 tst ping_idle_ping.py: using BVCI 40661 11:43:26.273983 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:26.285711 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:26.297180 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:26.308621 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:26.320053 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:26.331493 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:26.342901 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:26.354233 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:43:26.471981 tst ping_idle_ping.py:24: start network... 11:43:26.676492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:27.152936 run create_hlr_db(pid=17613): Launched 11:43:27.269470 bus /gobi_6: Setting Powered False 11:43:28.330371 run create_hlr_db(pid=17613): Terminated: ok {rc=0} 11:43:28.775101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Launched 11:43:29.101758 run osmo-hlr_10.42.42.2(pid=17616): Launched 11:43:29.225391 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:29.782772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17618): Launched 11:43:30.107973 run osmo-stp_10.42.42.5(pid=17619): Launched 11:43:30.231431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:30.792394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17621): Launched 11:43:30.962937 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:31.242333 run patchelf(pid=17622): Launched 11:43:31.468480 run osmo-stp_10.42.42.5(pid=17619): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17619)] 11:43:31.607100 run osmo-stp_10.42.42.5(pid=17619): stdout: | (launched: 2022-12-14_11:43:30.047945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:31.746350 run osmo-stp_10.42.42.5(pid=17619): stderr: | [0;m[38;5;43m20221214114330239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114330239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114330240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114330240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114330241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114330241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114330241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:31.887965 run osmo-stp_10.42.42.5(pid=17619): stdout: | (launched: 2022-12-14_11:43:30.047945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:32.045547 run osmo-stp_10.42.42.5(pid=17619): stderr: | [0;m[38;5;43m20221214114330239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114330239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114330240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114330240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114330241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114330241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114330241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:32.199092 run patchelf(pid=17622): Terminating (SIGINT) 11:43:32.372222 run patchelf(pid=17622): Terminated: ok {rc=0} 11:43:32.496031 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17619): Process ended prematurely: osmo-stp_10.42.42.5(pid=17619) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17619)] [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:43:32.505374 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:43:32.532613 run osmo-hlr_10.42.42.2(pid=17616): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17616)] 11:43:32.582446 run osmo-hlr_10.42.42.2(pid=17616): stdout: | (launched: 2022-12-14_11:43:29.041390) 11:43:32.633476 run osmo-hlr_10.42.42.2(pid=17616): stderr: | [0;m[1;31m20221214114329240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114329240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114329240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114329240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114329240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114329240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114329255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114329264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114329265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114329265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:32.685294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Terminating (SIGTERM) 11:43:32.727107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17618): Terminating (SIGTERM) 11:43:32.768675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17621): Terminating (SIGTERM) 11:43:32.810555 --- ParallelTerminationStrategy: PID 17615 died... 11:43:32.830258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Terminated: ok {rc=0} 11:43:32.875248 --- ParallelTerminationStrategy: PID 17618 died... 11:43:32.894568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17618): Terminated: ok {rc=0} 11:43:32.939758 --- ParallelTerminationStrategy: PID 17621 died... 11:43:32.959106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17621): Terminated: ok {rc=0} 11:43:33.047158 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:43:34.333823 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:34.340374 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:43:34.360760 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:43:34.396096 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:43:34.448766 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:43:34.469225 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:43:34.503524 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:43:35.064875 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:43:35.070228 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:43:35.081796 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:43:35.138785 tst switch_tch_pdch.py: using LAC 40661 11:43:35.264487 tst switch_tch_pdch.py: using RAC 116 11:43:35.391719 tst switch_tch_pdch.py: using CellId 40661 11:43:35.517392 tst switch_tch_pdch.py: using BVCI 40662 11:43:35.634433 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:43:35.646251 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:43:35.657713 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:43:35.669184 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:43:35.680482 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:43:35.691953 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:43:35.703605 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:43:35.715009 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:43:35.833564 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:43:35.954030 tst switch_tch_pdch.py:51: start network... 11:43:36.171286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:36.671678 run create_hlr_db(pid=17626): Launched 11:43:36.803982 bus /gobi_6: Setting Powered False 11:43:37.867244 run create_hlr_db(pid=17626): Terminated: ok {rc=0} 11:43:38.318787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17628): Launched 11:43:38.641834 run osmo-hlr_10.42.42.2(pid=17629): Launched 11:43:38.765514 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:39.323048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17631): Launched 11:43:39.647484 run osmo-stp_10.42.42.5(pid=17632): Launched 11:43:39.770758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:40.328888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17634): Launched 11:43:40.453890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:40.727362 run patchelf(pid=17635): Launched 11:43:40.909058 run osmo-stp_10.42.42.5(pid=17632): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17632)] 11:43:41.046218 run osmo-stp_10.42.42.5(pid=17632): stdout: | (launched: 2022-12-14_11:43:39.587595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:41.185224 run osmo-stp_10.42.42.5(pid=17632): stderr: | [0;m[38;5;43m20221214114339780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114339780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114339780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114339781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114339781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114339781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114339781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:41.323570 run osmo-stp_10.42.42.5(pid=17632): stdout: | (launched: 2022-12-14_11:43:39.587595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:41.455632 run osmo-stp_10.42.42.5(pid=17632): stderr: | [0;m[38;5;43m20221214114339780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114339780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114339780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114339781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114339781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114339781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114339781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:41.612433 run patchelf(pid=17635): Terminating (SIGINT) 11:43:41.793219 run patchelf(pid=17635): Terminated: ok {rc=0} 11:43:41.924345 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17632): Process ended prematurely: osmo-stp_10.42.42.5(pid=17632) [trial-2404↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17632)] [trial-2404↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:43:41.933878 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 11:43:41.961822 run osmo-hlr_10.42.42.2(pid=17629): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17629)] 11:43:42.012022 run osmo-hlr_10.42.42.2(pid=17629): stdout: | (launched: 2022-12-14_11:43:38.582059) 11:43:42.064066 run osmo-hlr_10.42.42.2(pid=17629): stderr: | [0;m[1;31m20221214114338780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114338780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114338780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114338780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114338780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114338780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114338792 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114338800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114338800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114338801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:42.116615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17628): Terminating (SIGTERM) 11:43:42.158527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17631): Terminating (SIGTERM) 11:43:42.200509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17634): Terminating (SIGTERM) 11:43:42.243060 --- ParallelTerminationStrategy: PID 17628 died... 11:43:42.263234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17628): Terminated: ok {rc=0} 11:43:42.309231 --- ParallelTerminationStrategy: PID 17631 died... 11:43:42.328595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17631): Terminated: ok {rc=0} 11:43:42.374579 --- ParallelTerminationStrategy: PID 17634 died... 11:43:42.394199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17634): Terminated: ok {rc=0} 11:43:42.482387 bus /gobi_0: Setting Powered False 11:43:43.580909 bus /gobi_0: Setting Powered False 11:43:44.697944 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:43:45.942264 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:45.948446 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:43:45.975049 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:43:46.012188 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:43:46.074984 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:43:46.100891 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:43:46.144756 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:43:46.683052 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:43:46.691914 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:46.706796 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:43:46.773142 tst switch_tch_pdch.py: using LAC 40662 11:43:46.920871 tst switch_tch_pdch.py: using RAC 117 11:43:47.065777 tst switch_tch_pdch.py: using CellId 40662 11:43:47.186449 tst switch_tch_pdch.py: using BVCI 40663 11:43:47.328108 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:47.339413 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:47.350918 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:47.362192 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:47.374319 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:47.386914 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:47.398948 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:43:47.410799 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:43:47.533571 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:43:47.652025 tst switch_tch_pdch.py:51: start network... 11:43:47.856111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:48.299118 run create_hlr_db(pid=17639): Launched 11:43:48.416766 bus /gobi_6: Setting Powered False 11:43:49.477477 run create_hlr_db(pid=17639): Terminated: ok {rc=0} 11:43:49.893945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17641): Launched 11:43:50.218823 run osmo-hlr_10.42.42.2(pid=17642): Launched 11:43:50.342751 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:50.876136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17644): Launched 11:43:51.199095 run osmo-stp_10.42.42.5(pid=17645): Launched 11:43:51.322970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:51.852440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17647): Launched 11:43:51.976580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:52.251308 run patchelf(pid=17648): Launched 11:43:52.431890 run osmo-stp_10.42.42.5(pid=17645): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17645)] 11:43:52.568625 run osmo-stp_10.42.42.5(pid=17645): stdout: | (launched: 2022-12-14_11:43:51.139537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:52.706990 run osmo-stp_10.42.42.5(pid=17645): stderr: | [0;m[38;5;43m20221214114351330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114351330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114351330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114351330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114351331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114351331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114351331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:52.845749 run osmo-stp_10.42.42.5(pid=17645): stdout: | (launched: 2022-12-14_11:43:51.139537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:52.978420 run osmo-stp_10.42.42.5(pid=17645): stderr: | [0;m[38;5;43m20221214114351330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114351330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114351330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114351330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114351331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114351331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114351331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:53.135127 run patchelf(pid=17648): Terminating (SIGINT) 11:43:53.315536 run patchelf(pid=17648): Terminated: ok {rc=0} 11:43:53.445607 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17645): Process ended prematurely: osmo-stp_10.42.42.5(pid=17645) [trial-2404↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17645)] [trial-2404↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:43:53.455293 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 11:43:53.483290 run osmo-hlr_10.42.42.2(pid=17642): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17642)] 11:43:53.533894 run osmo-hlr_10.42.42.2(pid=17642): stdout: | (launched: 2022-12-14_11:43:50.159158) 11:43:53.586170 run osmo-hlr_10.42.42.2(pid=17642): stderr: | [0;m[1;31m20221214114350355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114350355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114350355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114350356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114350356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114350356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114350368 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114350377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114350377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114350377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:53.638756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17641): Terminating (SIGTERM) 11:43:53.681639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17644): Terminating (SIGTERM) 11:43:53.724558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17647): Terminating (SIGTERM) 11:43:53.767622 --- ParallelTerminationStrategy: PID 17641 died... 11:43:53.788170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17641): Terminated: ok {rc=0} 11:43:53.834678 --- ParallelTerminationStrategy: PID 17644 died... 11:43:53.854368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17644): Terminated: ok {rc=0} 11:43:53.900933 --- ParallelTerminationStrategy: PID 17647 died... 11:43:53.920747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17647): Terminated: ok {rc=0} 11:43:54.008715 bus /gobi_0: Setting Powered False 11:43:55.108715 bus /gobi_0: Setting Powered False 11:43:56.226107 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_sms:trx-b200 --------------------------------------------------------------------- 11:43:57.466075 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:57.470230 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 11:43:57.504058 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 11:43:57.511247 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 11:43:57.563444 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 11:43:57.597509 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 11:43:57.604423 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 11:43:58.143871 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 11:43:58.149294 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 11:43:58.160052 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 11:43:58.210010 tst mo_mt_sms.py: using LAC 40663 11:43:58.331247 tst mo_mt_sms.py: using RAC 118 11:43:58.449200 tst mo_mt_sms.py: using CellId 40663 11:43:58.566643 tst mo_mt_sms.py: using BVCI 40664 11:43:58.677898 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 11:43:58.797484 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 11:43:58.913698 tst mo_mt_sms.py:9: start nitb and bts... 11:43:59.117968 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:43:59.736003 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17654): Launched 11:44:00.039958 run osmo-nitb_10.42.42.2(pid=17655): Launched 11:44:00.208590 run osmo-nitb_10.42.42.2(pid=17655): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17655)] 11:44:00.344740 run osmo-nitb_10.42.42.2(pid=17655): stdout: | (launched: 2022-12-14_11:43:59.983423) 11:44:00.482898 run osmo-nitb_10.42.42.2(pid=17655): stderr: | (launched: 2022-12-14_11:44:00.028349) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:44:00.620622 run osmo-nitb_10.42.42.2(pid=17655): stdout: | (launched: 2022-12-14_11:43:59.983423) 11:44:00.752035 run osmo-nitb_10.42.42.2(pid=17655): stderr: | (launched: 2022-12-14_11:44:00.028349) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17655): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17655) [trial-2404↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17655)] 11:44:01.154596 tst osmo-nitb_10.42.42.2(pid=17655): stdout: | (launched: 2022-12-14_11:43:59.983423) 11:44:01.278800 tst osmo-nitb_10.42.42.2(pid=17655): stderr: | (launched: 2022-12-14_11:44:00.028349) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:44:01.427111 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=17655): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17655) [trial-2404↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17655)] [trial-2404↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 11:44:01.436623 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 11:44:01.444355 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17654): Terminating (SIGTERM) 11:44:01.656359 --- ParallelTerminationStrategy: PID 17654 died... 11:44:01.675839 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17654): Terminated: ok {rc=0} 11:44:01.765809 bus /sierra_3: Setting Powered False 11:44:02.865448 bus /sierra_3: Setting Powered False 11:44:03.983927 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 sms:trx-b200 --------------------------------------------------------------------- 11:44:05.185066 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:05.189197 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 11:44:05.222028 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:44:05.249460 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 11:44:05.301914 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 11:44:05.336642 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:44:05.364592 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 11:44:05.910800 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 11:44:05.916243 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:05.927364 tst sms:trx-b200: Using 1 x bts (candidates: 1) 11:44:05.979710 tst mo_mt_sms.py: using LAC 40664 11:44:06.106535 tst mo_mt_sms.py: using RAC 119 11:44:06.231415 tst mo_mt_sms.py: using CellId 40664 11:44:06.356838 tst mo_mt_sms.py: using BVCI 40665 11:44:06.474397 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:06.485514 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:06.496396 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:06.507211 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:06.518284 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:06.529348 tst sms:trx-b200: Using 1 x modem (candidates: 2) 11:44:06.646301 tst sms:trx-b200: Using 1 x modem (candidates: 2) 11:44:06.768270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:07.274528 run create_hlr_db(pid=17660): Launched 11:44:07.407643 bus /sierra_2: Setting Powered False 11:44:08.471172 run create_hlr_db(pid=17660): Terminated: ok {rc=0} 11:44:08.905511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17662): Launched 11:44:09.210745 run osmo-hlr_10.42.42.2(pid=17663): Launched 11:44:09.325373 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:09.854427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17665): Launched 11:44:10.156308 run osmo-stp_10.42.42.5(pid=17666): Launched 11:44:10.270911 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:10.818223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17668): Launched 11:44:11.123931 run osmo-msc_10.42.42.6(pid=17669): Launched 11:44:11.293350 run osmo-stp_10.42.42.5(pid=17666): ERR: Terminated: ERROR {rc=1} [trial-2404↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17666)] 11:44:11.422040 run osmo-stp_10.42.42.5(pid=17666): stdout: | (launched: 2022-12-14_11:44:10.100158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:11.550463 run osmo-stp_10.42.42.5(pid=17666): stderr: | [0;m[38;5;43m20221214114410267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114410267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114410267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114410268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114410268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114410268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114410268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:11.676153 run osmo-stp_10.42.42.5(pid=17666): stdout: | (launched: 2022-12-14_11:44:10.100158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:11.795923 run osmo-stp_10.42.42.5(pid=17666): stderr: | [0;m[38;5;43m20221214114410267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114410267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114410267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114410268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114410268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114410268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114410268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:11.939504 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17666): Process ended prematurely: osmo-stp_10.42.42.5(pid=17666) [trial-2404↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17666)] [trial-2404↪sms:trx-b200↪mo_mt_sms.py:16] 11:44:11.947836 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 11:44:11.973849 run osmo-hlr_10.42.42.2(pid=17663): ERR: Terminated: ERROR {rc=237} [trial-2404↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17663)] 11:44:12.022950 run osmo-hlr_10.42.42.2(pid=17663): stdout: | (launched: 2022-12-14_11:44:09.153828) 11:44:12.073284 run osmo-hlr_10.42.42.2(pid=17663): stderr: | [0;m[1;31m20221214114409327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114409327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114409327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114409327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114409327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114409327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114409340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114409349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114409349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114409349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:12.144111 run osmo-msc_10.42.42.6(pid=17669): ERR: Terminated: ERROR {rc=2} [trial-2404↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17669)] 11:44:12.192304 run osmo-msc_10.42.42.6(pid=17669): stdout: | (launched: 2022-12-14_11:44:11.067533) 11:44:12.242259 run osmo-msc_10.42.42.6(pid=17669): stderr: | [0;m[38;5;43m20221214114411335 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114411337 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f302fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114411337 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114411337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114411337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114411337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114411339 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114411339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114411339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114411339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:12.292727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17662): Terminating (SIGTERM) 11:44:12.333437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17665): Terminating (SIGTERM) 11:44:12.374555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17668): Terminating (SIGTERM) 11:44:12.415312 --- ParallelTerminationStrategy: PID 17662 died... 11:44:12.434946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17662): Terminated: ok {rc=0} 11:44:12.479569 --- ParallelTerminationStrategy: PID 17665 died... 11:44:12.498528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17665): Terminated: ok {rc=0} 11:44:12.542963 --- ParallelTerminationStrategy: PID 17668 died... 11:44:12.562155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17668): Terminated: ok {rc=0} 11:44:12.652705 bus /sierra_3: Setting Powered False 11:44:13.751811 bus /sierra_3: Setting Powered False 11:44:14.866687 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-b200 --------------------------------------------------------------------- 11:44:16.106947 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:16.110959 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 11:44:16.146221 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 11:44:16.153887 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 11:44:16.189892 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 11:44:16.226733 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 11:44:16.235782 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 11:44:16.765101 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 11:44:16.773146 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 11:44:16.789498 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 11:44:16.849765 tst assert_extension.py: using LAC 40665 11:44:16.981377 tst assert_extension.py: using RAC 120 11:44:17.136178 tst assert_extension.py: using CellId 40665 11:44:17.278228 tst assert_extension.py: using BVCI 40666 11:44:17.390737 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 11:44:17.510007 tst assert_extension.py:10: start nitb and bts... 11:44:17.729911 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:44:18.391652 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17674): Launched 11:44:18.715650 run osmo-nitb_10.42.42.2(pid=17675): Launched 11:44:18.895650 run osmo-nitb_10.42.42.2(pid=17675): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17675)] 11:44:19.041269 run osmo-nitb_10.42.42.2(pid=17675): stdout: | (launched: 2022-12-14_11:44:18.656084) 11:44:19.188846 run osmo-nitb_10.42.42.2(pid=17675): stderr: | (launched: 2022-12-14_11:44:18.704107) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:44:19.335567 run osmo-nitb_10.42.42.2(pid=17675): stdout: | (launched: 2022-12-14_11:44:18.656084) 11:44:19.476060 run osmo-nitb_10.42.42.2(pid=17675): stderr: | (launched: 2022-12-14_11:44:18.704107) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17675): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17675) [trial-2404↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17675)] 11:44:19.838849 tst osmo-nitb_10.42.42.2(pid=17675): stdout: | (launched: 2022-12-14_11:44:18.656084) 11:44:19.969975 tst osmo-nitb_10.42.42.2(pid=17675): stderr: | (launched: 2022-12-14_11:44:18.704107) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:44:20.123701 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17675): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17675) [trial-2404↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17675)] [trial-2404↪nitb_ussd:trx-b200↪assert_extension.py:12] 11:44:20.133005 tst assert_extension.py:12: Test FAILED (3.4 sec) 11:44:20.140256 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17674): Terminating (SIGTERM) 11:44:20.351159 --- ParallelTerminationStrategy: PID 17674 died... 11:44:20.373134 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17674): Terminated: ok {rc=0} 11:44:20.462791 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 ussd:trx-b200 --------------------------------------------------------------------- 11:44:21.645558 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:21.650281 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 11:44:21.682922 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:44:21.710465 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 11:44:21.744696 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 11:44:21.779314 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:44:21.807114 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 11:44:22.336542 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 ussd:trx-b200 assert_extension.py ---------------------------------------------- 11:44:22.342973 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:22.354270 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 11:44:22.402016 tst assert_extension.py: using LAC 40666 11:44:22.528247 tst assert_extension.py: using RAC 121 11:44:22.653078 tst assert_extension.py: using CellId 40666 11:44:22.778955 tst assert_extension.py: using BVCI 40667 11:44:22.896422 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:22.907630 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:22.919064 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:22.929997 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:22.940902 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:44:22.951838 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 11:44:23.068365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:23.537342 run create_hlr_db(pid=17679): Launched 11:44:23.670869 bus /sierra_2: Setting Powered False 11:44:24.733558 run create_hlr_db(pid=17679): Terminated: ok {rc=0} 11:44:25.187603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17681): Launched 11:44:25.513936 run osmo-hlr_10.42.42.2(pid=17682): Launched 11:44:25.633856 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:26.163321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17685): Launched 11:44:26.466232 run osmo-stp_10.42.42.5(pid=17686): Launched 11:44:26.583404 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:27.127195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17688): Launched 11:44:27.429653 run osmo-msc_10.42.42.6(pid=17689): Launched 11:44:27.600101 run osmo-stp_10.42.42.5(pid=17686): ERR: Terminated: ERROR {rc=1} [trial-2404↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17686)] 11:44:27.728233 run osmo-stp_10.42.42.5(pid=17686): stdout: | (launched: 2022-12-14_11:44:26.409703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:27.856432 run osmo-stp_10.42.42.5(pid=17686): stderr: | [0;m[38;5;43m20221214114426581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114426581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114426582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114426582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114426583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114426583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114426583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:27.983176 run osmo-stp_10.42.42.5(pid=17686): stdout: | (launched: 2022-12-14_11:44:26.409703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:28.103466 run osmo-stp_10.42.42.5(pid=17686): stderr: | [0;m[38;5;43m20221214114426581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114426581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114426582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114426582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114426583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114426583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114426583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:28.247150 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17686): Process ended prematurely: osmo-stp_10.42.42.5(pid=17686) [trial-2404↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17686)] [trial-2404↪ussd:trx-b200↪assert_extension.py:17] 11:44:28.255566 tst assert_extension.py:17: Test FAILED (5.9 sec) 11:44:28.281618 run osmo-hlr_10.42.42.2(pid=17682): ERR: Terminated: ERROR {rc=237} [trial-2404↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17682)] 11:44:28.331134 run osmo-hlr_10.42.42.2(pid=17682): stdout: | (launched: 2022-12-14_11:44:25.453991) 11:44:28.381676 run osmo-hlr_10.42.42.2(pid=17682): stderr: | [0;m[1;31m20221214114425635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114425635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114425636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114425636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114425636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114425636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114425648 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114425656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114425656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114425656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:28.452054 run osmo-msc_10.42.42.6(pid=17689): ERR: Terminated: ERROR {rc=2} [trial-2404↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17689)] 11:44:28.500289 run osmo-msc_10.42.42.6(pid=17689): stdout: | (launched: 2022-12-14_11:44:27.373251) 11:44:28.550529 run osmo-msc_10.42.42.6(pid=17689): stderr: | [0;m[38;5;43m20221214114427642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114427642 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6327b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114427642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114427642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114427642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114427643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114427644 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114427645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114427645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114427645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:28.601546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17681): Terminating (SIGTERM) 11:44:28.642034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17685): Terminating (SIGTERM) 11:44:28.682651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17688): Terminating (SIGTERM) 11:44:28.723510 --- ParallelTerminationStrategy: PID 17681 died... 11:44:28.743439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17681): Terminated: ok {rc=0} 11:44:28.788402 --- ParallelTerminationStrategy: PID 17685 died... 11:44:28.807602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17685): Terminated: ok {rc=0} 11:44:28.852215 --- ParallelTerminationStrategy: PID 17688 died... 11:44:28.871471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17688): Terminated: ok {rc=0} 11:44:28.960124 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:44:30.182844 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:30.190035 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:44:30.224776 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:44:30.252357 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:44:30.307398 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:44:30.341548 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:44:30.368904 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:44:30.928790 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:44:30.991396 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:31.003396 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:44:31.075099 tst mo_mt_call.py: using LAC 40667 11:44:31.233671 tst mo_mt_call.py: using RAC 122 11:44:31.364907 tst mo_mt_call.py: using CellId 40667 11:44:31.497569 tst mo_mt_call.py: using BVCI 40668 11:44:31.617222 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:31.629950 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:31.642245 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:31.655028 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:31.668120 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:31.681634 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:44:31.811199 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:44:31.955606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:32.468649 run create_hlr_db(pid=17694): Launched 11:44:32.588127 bus /sierra_2: Setting Powered False 11:44:33.649462 run create_hlr_db(pid=17694): Terminated: ok {rc=0} 11:44:34.078710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17696): Launched 11:44:34.386503 run osmo-hlr_10.42.42.2(pid=17697): Launched 11:44:34.502956 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:35.044351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17699): Launched 11:44:35.353914 run osmo-stp_10.42.42.5(pid=17700): Launched 11:44:35.473852 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:36.032272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17702): Launched 11:44:36.364893 run osmo-msc_10.42.42.6(pid=17703): Launched 11:44:36.549270 run osmo-stp_10.42.42.5(pid=17700): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17700)] 11:44:36.688490 run osmo-stp_10.42.42.5(pid=17700): stdout: | (launched: 2022-12-14_11:44:35.296551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:36.827819 run osmo-stp_10.42.42.5(pid=17700): stderr: | [0;m[38;5;43m20221214114435467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114435467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114435467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114435467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114435468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114435468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114435468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:36.966284 run osmo-stp_10.42.42.5(pid=17700): stdout: | (launched: 2022-12-14_11:44:35.296551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:37.097919 run osmo-stp_10.42.42.5(pid=17700): stderr: | [0;m[38;5;43m20221214114435467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114435467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114435467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114435467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114435468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114435468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114435468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:37.255559 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17700): Process ended prematurely: osmo-stp_10.42.42.5(pid=17700) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17700)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:44:37.265627 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:44:37.293759 run osmo-hlr_10.42.42.2(pid=17697): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17697)] 11:44:37.345351 run osmo-hlr_10.42.42.2(pid=17697): stdout: | (launched: 2022-12-14_11:44:34.328924) 11:44:37.398482 run osmo-hlr_10.42.42.2(pid=17697): stderr: | [0;m[1;31m20221214114434503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114434503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114434503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114434503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114434503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114434503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114434515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114434524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114434524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114434524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:37.471980 run osmo-msc_10.42.42.6(pid=17703): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17703)] 11:44:37.523011 run osmo-msc_10.42.42.6(pid=17703): stdout: | (launched: 2022-12-14_11:44:36.303852) 11:44:37.575761 run osmo-msc_10.42.42.6(pid=17703): stderr: | [0;m[38;5;43m20221214114436625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114436625 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6a5db2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114436625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114436625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114436625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114436626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114436627 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114436628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114436628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114436628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:37.629201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17696): Terminating (SIGTERM) 11:44:37.671401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17699): Terminating (SIGTERM) 11:44:37.713857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17702): Terminating (SIGTERM) 11:44:37.756447 --- ParallelTerminationStrategy: PID 17696 died... 11:44:37.776908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17696): Terminated: ok {rc=0} 11:44:37.824242 --- ParallelTerminationStrategy: PID 17699 died... 11:44:37.844314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17699): Terminated: ok {rc=0} 11:44:37.891141 --- ParallelTerminationStrategy: PID 17702 died... 11:44:37.911527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17702): Terminated: ok {rc=0} 11:44:38.001970 bus /sierra_3: Setting Powered False 11:44:39.102656 bus /sierra_3: Setting Powered False 11:44:40.222854 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:44:41.372514 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:41.384297 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:44:41.453992 tst mo_mt_call_osmux.py: using LAC 40668 11:44:41.575450 tst mo_mt_call_osmux.py: using RAC 123 11:44:41.697571 tst mo_mt_call_osmux.py: using CellId 40668 11:44:41.827677 tst mo_mt_call_osmux.py: using BVCI 40669 11:44:41.950291 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:41.962126 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:41.973831 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:41.985476 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:41.997300 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:44:42.008803 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:44:42.127882 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:44:42.250419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:42.760903 run create_hlr_db(pid=17705): Launched 11:44:42.894146 bus /sierra_2: Setting Powered False 11:44:43.959322 run create_hlr_db(pid=17705): Terminated: ok {rc=0} 11:44:44.399741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17707): Launched 11:44:44.708608 run osmo-hlr_10.42.42.2(pid=17708): Launched 11:44:44.826151 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:45.360403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17710): Launched 11:44:45.668817 run osmo-stp_10.42.42.5(pid=17711): Launched 11:44:45.785281 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:46.354504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17713): Launched 11:44:46.683340 run osmo-msc_10.42.42.6(pid=17714): Launched 11:44:47.040503 run osmo-stp_10.42.42.5(pid=17711): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17711)] 11:44:47.467301 run osmo-stp_10.42.42.5(pid=17711): stdout: | (launched: 2022-12-14_11:44:45.611620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:47.599194 run osmo-stp_10.42.42.5(pid=17711): stderr: | [0;m[38;5;43m20221214114445783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114445783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114445783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114445783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114445784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114445784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114445784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:47.728572 run osmo-stp_10.42.42.5(pid=17711): stdout: | (launched: 2022-12-14_11:44:45.611620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:47.851495 run osmo-stp_10.42.42.5(pid=17711): stderr: | [0;m[38;5;43m20221214114445783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114445783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114445783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114445783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114445784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114445784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114445784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:47.998772 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17711): Process ended prematurely: osmo-stp_10.42.42.5(pid=17711) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17711)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:44:48.007869 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 11:44:48.034639 run osmo-hlr_10.42.42.2(pid=17708): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17708)] 11:44:48.085169 run osmo-hlr_10.42.42.2(pid=17708): stdout: | (launched: 2022-12-14_11:44:44.651227) 11:44:48.136481 run osmo-hlr_10.42.42.2(pid=17708): stderr: | [0;m[1;31m20221214114444825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114444825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114444825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114444825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114444825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114444825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114444837 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114444845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114444845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114444846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:48.208699 run osmo-msc_10.42.42.6(pid=17714): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17714)] 11:44:48.257523 run osmo-msc_10.42.42.6(pid=17714): stdout: | (launched: 2022-12-14_11:44:46.624159) 11:44:48.309249 run osmo-msc_10.42.42.6(pid=17714): stderr: | [0;m[38;5;43m20221214114447217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114447217 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa56de72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114447218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114447218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114447219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114447219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114447224 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114447225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114447225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114447226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:48.360694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17707): Terminating (SIGTERM) 11:44:48.402380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17710): Terminating (SIGTERM) 11:44:48.444271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17713): Terminating (SIGTERM) 11:44:48.486323 --- ParallelTerminationStrategy: PID 17707 died... 11:44:48.506654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17707): Terminated: ok {rc=0} 11:44:48.552473 --- ParallelTerminationStrategy: PID 17710 died... 11:44:48.572321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17710): Terminated: ok {rc=0} 11:44:48.618017 --- ParallelTerminationStrategy: PID 17713 died... 11:44:48.637907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17713): Terminated: ok {rc=0} 11:44:48.727420 bus /sierra_3: Setting Powered False 11:44:49.828864 bus /sierra_3: Setting Powered False 11:44:50.945506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:44:52.199295 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:52.206298 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:44:52.239813 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:44:52.266676 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:44:52.319018 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:44:52.353447 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:44:52.382209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:44:52.927254 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:44:52.977898 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:52.989110 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:44:53.057829 tst mo_mt_call.py: using LAC 40669 11:44:53.179840 tst mo_mt_call.py: using RAC 124 11:44:53.301779 tst mo_mt_call.py: using CellId 40669 11:44:53.426510 tst mo_mt_call.py: using BVCI 40670 11:44:53.538982 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:53.550158 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:53.561199 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:53.572035 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:53.583196 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:44:53.594483 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:44:53.716301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:44:53.838358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:54.351117 run create_hlr_db(pid=17719): Launched 11:44:54.486326 bus /sierra_2: Setting Powered False 11:44:55.551376 run create_hlr_db(pid=17719): Terminated: ok {rc=0} 11:44:55.992009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17721): Launched 11:44:56.301394 run osmo-hlr_10.42.42.2(pid=17722): Launched 11:44:56.418557 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:56.961391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17724): Launched 11:44:57.269391 run osmo-stp_10.42.42.5(pid=17725): Launched 11:44:57.386706 run osmo-msc_10.42.42.6: Starting osmo-msc 11:44:57.946182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17727): Launched 11:44:58.255322 run osmo-msc_10.42.42.6(pid=17728): Launched 11:44:58.427000 run osmo-stp_10.42.42.5(pid=17725): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17725)] 11:44:58.557493 run osmo-stp_10.42.42.5(pid=17725): stdout: | (launched: 2022-12-14_11:44:57.212260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:58.688486 run osmo-stp_10.42.42.5(pid=17725): stderr: | [0;m[38;5;43m20221214114457384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114457385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114457385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114457385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:58.817715 run osmo-stp_10.42.42.5(pid=17725): stdout: | (launched: 2022-12-14_11:44:57.212260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:58.940072 run osmo-stp_10.42.42.5(pid=17725): stderr: | [0;m[38;5;43m20221214114457384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114457385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114457385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114457385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:59.086684 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17725): Process ended prematurely: osmo-stp_10.42.42.5(pid=17725) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17725)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:44:59.095822 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:44:59.122666 run osmo-hlr_10.42.42.2(pid=17722): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17722)] 11:44:59.172009 run osmo-hlr_10.42.42.2(pid=17722): stdout: | (launched: 2022-12-14_11:44:56.244146) 11:44:59.222771 run osmo-hlr_10.42.42.2(pid=17722): stderr: | [0;m[1;31m20221214114456419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114456419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114456420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114456420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114456420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114456420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114456431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114456440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114456440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114456440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:59.293594 run osmo-msc_10.42.42.6(pid=17728): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17728)] 11:44:59.342060 run osmo-msc_10.42.42.6(pid=17728): stdout: | (launched: 2022-12-14_11:44:58.197308) 11:44:59.393098 run osmo-msc_10.42.42.6(pid=17728): stderr: | [0;m[38;5;43m20221214114458467 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114458468 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe0569d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114458468 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114458468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114458468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114458468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114458470 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114458470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114458470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114458470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:44:59.443907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17721): Terminating (SIGTERM) 11:44:59.485039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17724): Terminating (SIGTERM) 11:44:59.526192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17727): Terminating (SIGTERM) 11:44:59.567443 --- ParallelTerminationStrategy: PID 17721 died... 11:44:59.587345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17721): Terminated: ok {rc=0} 11:44:59.632338 --- ParallelTerminationStrategy: PID 17724 died... 11:44:59.651840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17724): Terminated: ok {rc=0} 11:44:59.697182 --- ParallelTerminationStrategy: PID 17727 died... 11:44:59.716640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17727): Terminated: ok {rc=0} 11:44:59.802390 bus /sierra_3: Setting Powered False 11:45:00.911289 bus /sierra_3: Setting Powered False 11:45:02.043605 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:45:03.200188 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:45:03.212189 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:45:03.282504 tst mo_mt_call_osmux.py: using LAC 40670 11:45:03.404723 tst mo_mt_call_osmux.py: using RAC 125 11:45:03.525800 tst mo_mt_call_osmux.py: using CellId 40670 11:45:03.648381 tst mo_mt_call_osmux.py: using BVCI 40671 11:45:03.761466 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:45:03.772517 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:45:03.783513 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:45:03.794589 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:45:03.806169 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:45:03.817638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:45:03.938938 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:45:04.057048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:04.535088 run create_hlr_db(pid=17733): Launched 11:45:04.652829 bus /sierra_2: Setting Powered False 11:45:05.714120 run create_hlr_db(pid=17733): Terminated: ok {rc=0} 11:45:06.167838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17735): Launched 11:45:06.499188 run osmo-hlr_10.42.42.2(pid=17736): Launched 11:45:06.627387 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:07.199935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17738): Launched 11:45:07.531534 run osmo-stp_10.42.42.5(pid=17739): Launched 11:45:07.657796 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:08.261122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17741): Launched 11:45:08.591683 run osmo-msc_10.42.42.6(pid=17742): Launched 11:45:08.776617 run osmo-stp_10.42.42.5(pid=17739): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17739)] 11:45:08.918464 run osmo-stp_10.42.42.5(pid=17739): stdout: | (launched: 2022-12-14_11:45:07.470819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:09.058709 run osmo-stp_10.42.42.5(pid=17739): stderr: | [0;m[38;5;43m20221214114507663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114507663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114507664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114507664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114507664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114507665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114507665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:09.197096 run osmo-stp_10.42.42.5(pid=17739): stdout: | (launched: 2022-12-14_11:45:07.470819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:09.327917 run osmo-stp_10.42.42.5(pid=17739): stderr: | [0;m[38;5;43m20221214114507663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114507663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114507664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114507664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114507664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114507665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114507665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:09.485575 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17739): Process ended prematurely: osmo-stp_10.42.42.5(pid=17739) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17739)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:45:09.495565 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:45:09.523826 run osmo-hlr_10.42.42.2(pid=17736): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17736)] 11:45:09.574786 run osmo-hlr_10.42.42.2(pid=17736): stdout: | (launched: 2022-12-14_11:45:06.438205) 11:45:09.627210 run osmo-hlr_10.42.42.2(pid=17736): stderr: | [0;m[1;31m20221214114506636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114506636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114506637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114506637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114506637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114506637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114506649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114506657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114506657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114506658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:09.700280 run osmo-msc_10.42.42.6(pid=17742): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17742)] 11:45:09.750986 run osmo-msc_10.42.42.6(pid=17742): stdout: | (launched: 2022-12-14_11:45:08.530729) 11:45:09.803101 run osmo-msc_10.42.42.6(pid=17742): stderr: | [0;m[38;5;43m20221214114508850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114508850 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f43e868cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114508850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114508851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114508851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114508851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114508853 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114508853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114508853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114508853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:09.855562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17735): Terminating (SIGTERM) 11:45:09.898009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17738): Terminating (SIGTERM) 11:45:09.940505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17741): Terminating (SIGTERM) 11:45:09.983533 --- ParallelTerminationStrategy: PID 17735 died... 11:45:10.004177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17735): Terminated: ok {rc=0} 11:45:10.051025 --- ParallelTerminationStrategy: PID 17738 died... 11:45:10.070829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17738): Terminated: ok {rc=0} 11:45:10.117332 --- ParallelTerminationStrategy: PID 17741 died... 11:45:10.137046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17741): Terminated: ok {rc=0} 11:45:10.226049 bus /sierra_3: Setting Powered False 11:45:11.326470 bus /sierra_3: Setting Powered False 11:45:12.447034 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:45:13.698030 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:13.706520 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:45:13.740605 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:45:13.768179 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:45:13.820786 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:45:13.854873 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:45:13.882066 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:45:14.431382 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:45:14.482098 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:14.493409 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:45:14.568358 tst mo_mt_call.py: using LAC 40671 11:45:14.690456 tst mo_mt_call.py: using RAC 126 11:45:14.811818 tst mo_mt_call.py: using CellId 40671 11:45:14.930913 tst mo_mt_call.py: using BVCI 40672 11:45:15.044148 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:15.055341 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:15.066353 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:15.077197 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:15.088419 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:15.099829 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:45:15.222297 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:45:15.342338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:15.858524 run create_hlr_db(pid=17747): Launched 11:45:16.000471 bus /sierra_2: Setting Powered False 11:45:17.064908 run create_hlr_db(pid=17747): Terminated: ok {rc=0} 11:45:17.536104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17749): Launched 11:45:17.846056 run osmo-hlr_10.42.42.2(pid=17750): Launched 11:45:17.963326 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:18.502345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17752): Launched 11:45:18.810466 run osmo-stp_10.42.42.5(pid=17753): Launched 11:45:18.929587 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:19.487101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17755): Launched 11:45:19.796354 run osmo-msc_10.42.42.6(pid=17756): Launched 11:45:19.969538 run osmo-stp_10.42.42.5(pid=17753): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17753)] 11:45:20.101255 run osmo-stp_10.42.42.5(pid=17753): stdout: | (launched: 2022-12-14_11:45:18.753118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:20.232582 run osmo-stp_10.42.42.5(pid=17753): stderr: | [0;m[38;5;43m20221214114518923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114518924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114518924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114518924 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114518925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114518925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114518925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:20.362049 run osmo-stp_10.42.42.5(pid=17753): stdout: | (launched: 2022-12-14_11:45:18.753118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:20.484741 run osmo-stp_10.42.42.5(pid=17753): stderr: | [0;m[38;5;43m20221214114518923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114518924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114518924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114518924 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114518925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114518925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114518925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:20.631997 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17753): Process ended prematurely: osmo-stp_10.42.42.5(pid=17753) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17753)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:45:20.641236 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:45:20.667809 run osmo-hlr_10.42.42.2(pid=17750): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17750)] 11:45:20.717082 run osmo-hlr_10.42.42.2(pid=17750): stdout: | (launched: 2022-12-14_11:45:17.788181) 11:45:20.767205 run osmo-hlr_10.42.42.2(pid=17750): stderr: | [0;m[1;31m20221214114517966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114517966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114517966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114517966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114517966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114517966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114517977 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114517986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114517986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114517986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:20.837373 run osmo-msc_10.42.42.6(pid=17756): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17756)] 11:45:20.885463 run osmo-msc_10.42.42.6(pid=17756): stdout: | (launched: 2022-12-14_11:45:19.739085) 11:45:20.935796 run osmo-msc_10.42.42.6(pid=17756): stderr: | [0;m[38;5;43m20221214114520009 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114520010 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f80ca752c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114520010 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114520010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114520010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114520010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114520012 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114520012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114520012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114520012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:20.986533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17749): Terminating (SIGTERM) 11:45:21.027127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17752): Terminating (SIGTERM) 11:45:21.067711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17755): Terminating (SIGTERM) 11:45:21.109063 --- ParallelTerminationStrategy: PID 17749 died... 11:45:21.128686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17749): Terminated: ok {rc=0} 11:45:21.173720 --- ParallelTerminationStrategy: PID 17752 died... 11:45:21.193197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17752): Terminated: ok {rc=0} 11:45:21.237882 --- ParallelTerminationStrategy: PID 17755 died... 11:45:21.257224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17755): Terminated: ok {rc=0} 11:45:21.343258 bus /sierra_3: Setting Powered False 11:45:22.439549 bus /sierra_3: Setting Powered False 11:45:23.557475 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:45:24.706734 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:24.718692 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:45:24.792048 tst mo_mt_call_osmux.py: using LAC 40672 11:45:24.921337 tst mo_mt_call_osmux.py: using RAC 127 11:45:25.052315 tst mo_mt_call_osmux.py: using CellId 40672 11:45:25.180735 tst mo_mt_call_osmux.py: using BVCI 40673 11:45:25.300450 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:25.312065 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:25.323860 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:25.335284 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:25.346834 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:45:25.358264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:45:25.476320 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:45:25.599692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:26.111698 run create_hlr_db(pid=17758): Launched 11:45:26.246323 bus /sierra_2: Setting Powered False 11:45:27.311002 run create_hlr_db(pid=17758): Terminated: ok {rc=0} 11:45:27.769707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17760): Launched 11:45:28.099716 run osmo-hlr_10.42.42.2(pid=17761): Launched 11:45:28.223990 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:28.795273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17763): Launched 11:45:29.126284 run osmo-stp_10.42.42.5(pid=17764): Launched 11:45:29.251903 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:29.850967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17766): Launched 11:45:30.182963 run osmo-msc_10.42.42.6(pid=17767): Launched 11:45:30.366141 run osmo-stp_10.42.42.5(pid=17764): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17764)] 11:45:30.504361 run osmo-stp_10.42.42.5(pid=17764): stdout: | (launched: 2022-12-14_11:45:29.065487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:30.643355 run osmo-stp_10.42.42.5(pid=17764): stderr: | [0;m[38;5;43m20221214114529258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114529258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114529258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114529259 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114529259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114529259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114529259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:30.780647 run osmo-stp_10.42.42.5(pid=17764): stdout: | (launched: 2022-12-14_11:45:29.065487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:30.925101 run osmo-stp_10.42.42.5(pid=17764): stderr: | [0;m[38;5;43m20221214114529258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114529258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114529258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114529259 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114529259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114529259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114529259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:31.089366 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17764): Process ended prematurely: osmo-stp_10.42.42.5(pid=17764) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17764)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:45:31.099298 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:45:31.128248 run osmo-hlr_10.42.42.2(pid=17761): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17761)] 11:45:31.183466 run osmo-hlr_10.42.42.2(pid=17761): stdout: | (launched: 2022-12-14_11:45:28.038947) 11:45:31.237573 run osmo-hlr_10.42.42.2(pid=17761): stderr: | [0;m[1;31m20221214114528237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114528237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114528237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114528237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114528237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114528237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114528250 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114528258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114528258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114528258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:31.311883 run osmo-msc_10.42.42.6(pid=17767): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17767)] 11:45:31.365563 run osmo-msc_10.42.42.6(pid=17767): stdout: | (launched: 2022-12-14_11:45:30.121683) 11:45:31.419423 run osmo-msc_10.42.42.6(pid=17767): stderr: | [0;m[38;5;43m20221214114530442 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114530443 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f883620ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114530443 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114530443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114530443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114530443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114530445 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114530445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114530445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114530445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:31.475622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17760): Terminating (SIGTERM) 11:45:31.518743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17763): Terminating (SIGTERM) 11:45:31.566432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17766): Terminating (SIGTERM) 11:45:31.612852 --- ParallelTerminationStrategy: PID 17760 died... 11:45:31.635090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17760): Terminated: ok {rc=0} 11:45:31.686423 --- ParallelTerminationStrategy: PID 17763 died... 11:45:31.706737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17763): Terminated: ok {rc=0} 11:45:31.756310 --- ParallelTerminationStrategy: PID 17766 died... 11:45:31.776509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17766): Terminated: ok {rc=0} 11:45:31.866671 bus /sierra_3: Setting Powered False 11:45:32.965932 bus /sierra_3: Setting Powered False 11:45:34.083476 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:45:35.339929 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:35.348911 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:45:35.383701 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:45:35.410956 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:45:35.461936 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:45:35.494986 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:45:35.522418 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:45:36.075433 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:45:36.129065 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:36.140529 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:45:36.216567 tst mo_mt_call.py: using LAC 40673 11:45:36.345481 tst mo_mt_call.py: using RAC 128 11:45:36.474213 tst mo_mt_call.py: using CellId 40673 11:45:36.601583 tst mo_mt_call.py: using BVCI 40674 11:45:36.720878 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:36.732428 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:36.743798 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:36.755269 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:36.766746 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:36.778120 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:45:36.896169 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:45:37.018999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:37.532306 run create_hlr_db(pid=17773): Launched 11:45:37.667500 bus /sierra_2: Setting Powered False 11:45:38.732646 run create_hlr_db(pid=17773): Terminated: ok {rc=0} 11:45:39.174270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17775): Launched 11:45:39.485326 run osmo-hlr_10.42.42.2(pid=17776): Launched 11:45:39.603530 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:40.150570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17778): Launched 11:45:40.458226 run osmo-stp_10.42.42.5(pid=17779): Launched 11:45:40.575988 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:41.137199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17781): Launched 11:45:41.446877 run osmo-msc_10.42.42.6(pid=17782): Launched 11:45:41.619987 run osmo-stp_10.42.42.5(pid=17779): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17779)] 11:45:41.751083 run osmo-stp_10.42.42.5(pid=17779): stdout: | (launched: 2022-12-14_11:45:40.401142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:41.881842 run osmo-stp_10.42.42.5(pid=17779): stderr: | [0;m[38;5;43m20221214114540572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114540572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114540573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114540573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114540574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114540574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114540574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:42.015102 run osmo-stp_10.42.42.5(pid=17779): stdout: | (launched: 2022-12-14_11:45:40.401142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:42.137580 run osmo-stp_10.42.42.5(pid=17779): stderr: | [0;m[38;5;43m20221214114540572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114540572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114540573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114540573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114540574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114540574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114540574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:42.284046 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17779): Process ended prematurely: osmo-stp_10.42.42.5(pid=17779) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17779)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:45:42.293337 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:45:42.319936 run osmo-hlr_10.42.42.2(pid=17776): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17776)] 11:45:42.368636 run osmo-hlr_10.42.42.2(pid=17776): stdout: | (launched: 2022-12-14_11:45:39.427905) 11:45:42.418700 run osmo-hlr_10.42.42.2(pid=17776): stderr: | [0;m[1;31m20221214114539605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114539605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114539605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114539605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114539605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114539605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114539620 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114539633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114539633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114539634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:42.488125 run osmo-msc_10.42.42.6(pid=17782): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17782)] 11:45:42.535757 run osmo-msc_10.42.42.6(pid=17782): stdout: | (launched: 2022-12-14_11:45:41.389272) 11:45:42.585592 run osmo-msc_10.42.42.6(pid=17782): stderr: | [0;m[38;5;43m20221214114541657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114541657 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa8fb3cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114541657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114541657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114541658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114541658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114541659 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114541660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114541660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114541660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:42.635735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17775): Terminating (SIGTERM) 11:45:42.675963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17778): Terminating (SIGTERM) 11:45:42.716114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17781): Terminating (SIGTERM) 11:45:42.756679 --- ParallelTerminationStrategy: PID 17775 died... 11:45:42.776371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17775): Terminated: ok {rc=0} 11:45:42.821047 --- ParallelTerminationStrategy: PID 17778 died... 11:45:42.840316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17778): Terminated: ok {rc=0} 11:45:42.885630 --- ParallelTerminationStrategy: PID 17781 died... 11:45:42.904897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17781): Terminated: ok {rc=0} 11:45:42.992464 bus /sierra_3: Setting Powered False 11:45:44.094439 bus /sierra_3: Setting Powered False 11:45:45.210262 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:45:46.358233 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:46.371098 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:45:46.447022 tst mo_mt_call_osmux.py: using LAC 40674 11:45:46.619848 tst mo_mt_call_osmux.py: using RAC 129 11:45:46.786397 tst mo_mt_call_osmux.py: using CellId 40674 11:45:46.920549 tst mo_mt_call_osmux.py: using BVCI 40675 11:45:47.038998 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:47.051171 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:47.063171 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:47.075273 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:47.088375 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:45:47.101480 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:45:47.234413 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:45:47.356661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:47.835232 run create_hlr_db(pid=17784): Launched 11:45:47.954519 bus /sierra_2: Setting Powered False 11:45:49.015651 run create_hlr_db(pid=17784): Terminated: ok {rc=0} 11:45:49.468083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17786): Launched 11:45:49.799274 run osmo-hlr_10.42.42.2(pid=17787): Launched 11:45:49.926228 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:50.494302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17789): Launched 11:45:50.823886 run osmo-stp_10.42.42.5(pid=17790): Launched 11:45:50.950585 run osmo-msc_10.42.42.6: Starting osmo-msc 11:45:51.547770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17792): Launched 11:45:51.881419 run osmo-msc_10.42.42.6(pid=17793): Launched 11:45:52.069432 run osmo-stp_10.42.42.5(pid=17790): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17790)] 11:45:52.211624 run osmo-stp_10.42.42.5(pid=17790): stdout: | (launched: 2022-12-14_11:45:50.763295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:52.349497 run osmo-stp_10.42.42.5(pid=17790): stderr: | [0;m[38;5;43m20221214114550958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114550958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114550959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114550959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114550960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114550960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114550960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:52.487884 run osmo-stp_10.42.42.5(pid=17790): stdout: | (launched: 2022-12-14_11:45:50.763295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:52.619541 run osmo-stp_10.42.42.5(pid=17790): stderr: | [0;m[38;5;43m20221214114550958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114550958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114550959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114550959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114550960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114550960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114550960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:52.776713 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17790): Process ended prematurely: osmo-stp_10.42.42.5(pid=17790) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17790)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:45:52.786728 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:45:52.815051 run osmo-hlr_10.42.42.2(pid=17787): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17787)] 11:45:52.865823 run osmo-hlr_10.42.42.2(pid=17787): stdout: | (launched: 2022-12-14_11:45:49.737752) 11:45:52.918319 run osmo-hlr_10.42.42.2(pid=17787): stderr: | [0;m[1;31m20221214114549936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114549936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114549936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114549936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114549936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114549936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114549950 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114549958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114549959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114549959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:52.991604 run osmo-msc_10.42.42.6(pid=17793): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17793)] 11:45:53.042124 run osmo-msc_10.42.42.6(pid=17793): stdout: | (launched: 2022-12-14_11:45:51.820207) 11:45:53.094477 run osmo-msc_10.42.42.6(pid=17793): stderr: | [0;m[38;5;43m20221214114552150 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114552150 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f500b846c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114552150 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114552150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114552150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114552151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114552152 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114552153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114552153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114552153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:45:53.147025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17786): Terminating (SIGTERM) 11:45:53.189053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17789): Terminating (SIGTERM) 11:45:53.231331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17792): Terminating (SIGTERM) 11:45:53.273664 --- ParallelTerminationStrategy: PID 17786 died... 11:45:53.293895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17786): Terminated: ok {rc=0} 11:45:53.340234 --- ParallelTerminationStrategy: PID 17789 died... 11:45:53.360130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17789): Terminated: ok {rc=0} 11:45:53.406591 --- ParallelTerminationStrategy: PID 17792 died... 11:45:53.426445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17792): Terminated: ok {rc=0} 11:45:53.514199 bus /sierra_3: Setting Powered False 11:45:54.614011 bus /sierra_3: Setting Powered False 11:45:55.730674 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:45:56.984744 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:56.991390 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:45:57.024698 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:45:57.052446 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:45:57.102802 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:45:57.135571 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:45:57.162398 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:45:57.718697 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:45:57.771394 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:57.783086 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:45:57.853116 tst mo_mt_call.py: using LAC 40675 11:45:57.981109 tst mo_mt_call.py: using RAC 130 11:45:58.107824 tst mo_mt_call.py: using CellId 40675 11:45:58.238957 tst mo_mt_call.py: using BVCI 40676 11:45:58.359780 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:58.371321 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:58.382733 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:58.394188 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:58.405603 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:45:58.416887 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:45:58.535719 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:45:58.657677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:59.169481 run create_hlr_db(pid=17799): Launched 11:45:59.302991 bus /sierra_2: Setting Powered False 11:46:00.367229 run create_hlr_db(pid=17799): Terminated: ok {rc=0} 11:46:00.807433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17801): Launched 11:46:01.165697 run osmo-hlr_10.42.42.2(pid=17802): Launched 11:46:01.319362 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:01.997659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17804): Launched 11:46:02.339363 run osmo-stp_10.42.42.5(pid=17805): Launched 11:46:02.476173 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:03.034563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17807): Launched 11:46:03.345444 run osmo-msc_10.42.42.6(pid=17808): Launched 11:46:03.516699 run osmo-stp_10.42.42.5(pid=17805): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17805)] 11:46:03.647778 run osmo-stp_10.42.42.5(pid=17805): stdout: | (launched: 2022-12-14_11:46:02.280544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:03.778010 run osmo-stp_10.42.42.5(pid=17805): stderr: | [0;m[38;5;43m20221214114602514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114602515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114602515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114602515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114602516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114602516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114602516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:03.906952 run osmo-stp_10.42.42.5(pid=17805): stdout: | (launched: 2022-12-14_11:46:02.280544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:04.028874 run osmo-stp_10.42.42.5(pid=17805): stderr: | [0;m[38;5;43m20221214114602514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114602515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114602515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114602515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114602516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114602516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114602516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:04.175469 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17805): Process ended prematurely: osmo-stp_10.42.42.5(pid=17805) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17805)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:46:04.184492 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:46:04.210764 run osmo-hlr_10.42.42.2(pid=17802): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17802)] 11:46:04.258926 run osmo-hlr_10.42.42.2(pid=17802): stdout: | (launched: 2022-12-14_11:46:01.102426) 11:46:04.308477 run osmo-hlr_10.42.42.2(pid=17802): stderr: | [0;m[1;31m20221214114601472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114601472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114601472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114601472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114601472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114601472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114601498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114601515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114601517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114601517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:04.378287 run osmo-msc_10.42.42.6(pid=17808): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17808)] 11:46:04.425912 run osmo-msc_10.42.42.6(pid=17808): stdout: | (launched: 2022-12-14_11:46:03.288086) 11:46:04.475489 run osmo-msc_10.42.42.6(pid=17808): stderr: | [0;m[38;5;43m20221214114603560 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114603560 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a6511ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114603560 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114603560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114603561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114603561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114603562 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114603563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114603563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114603563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:04.525458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17801): Terminating (SIGTERM) 11:46:04.565545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17804): Terminating (SIGTERM) 11:46:04.605638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17807): Terminating (SIGTERM) 11:46:04.645880 --- ParallelTerminationStrategy: PID 17801 died... 11:46:04.665380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17801): Terminated: ok {rc=0} 11:46:04.709649 --- ParallelTerminationStrategy: PID 17804 died... 11:46:04.728376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17804): Terminated: ok {rc=0} 11:46:04.772748 --- ParallelTerminationStrategy: PID 17807 died... 11:46:04.791732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17807): Terminated: ok {rc=0} 11:46:04.877126 bus /sierra_3: Setting Powered False 11:46:05.976346 bus /sierra_3: Setting Powered False 11:46:07.096909 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:46:08.244680 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:46:08.256530 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:46:08.326422 tst mo_mt_call_osmux.py: using LAC 40676 11:46:08.450103 tst mo_mt_call_osmux.py: using RAC 131 11:46:08.580666 tst mo_mt_call_osmux.py: using CellId 40676 11:46:08.711382 tst mo_mt_call_osmux.py: using BVCI 40677 11:46:08.833004 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:46:08.844619 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:46:08.856442 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:46:08.868050 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:46:08.879635 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:46:08.891042 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:46:09.009836 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:46:09.132675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:09.645642 run create_hlr_db(pid=17810): Launched 11:46:09.779204 bus /sierra_2: Setting Powered False 11:46:10.843912 run create_hlr_db(pid=17810): Terminated: ok {rc=0} 11:46:11.304742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17812): Launched 11:46:11.636751 run osmo-hlr_10.42.42.2(pid=17813): Launched 11:46:11.763459 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:12.336359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17815): Launched 11:46:12.668327 run osmo-stp_10.42.42.5(pid=17816): Launched 11:46:12.794510 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:13.392334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17818): Launched 11:46:13.724799 run osmo-msc_10.42.42.6(pid=17819): Launched 11:46:13.909283 run osmo-stp_10.42.42.5(pid=17816): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17816)] 11:46:14.048867 run osmo-stp_10.42.42.5(pid=17816): stdout: | (launched: 2022-12-14_11:46:12.607389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:14.188318 run osmo-stp_10.42.42.5(pid=17816): stderr: | [0;m[38;5;43m20221214114612801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114612801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114612801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114612802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114612802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114612802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114612802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:14.326795 run osmo-stp_10.42.42.5(pid=17816): stdout: | (launched: 2022-12-14_11:46:12.607389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:14.458164 run osmo-stp_10.42.42.5(pid=17816): stderr: | [0;m[38;5;43m20221214114612801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114612801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114612801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114612802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114612802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114612802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114612802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:14.615114 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17816): Process ended prematurely: osmo-stp_10.42.42.5(pid=17816) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17816)] [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:46:14.625064 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:46:14.653265 run osmo-hlr_10.42.42.2(pid=17813): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17813)] 11:46:14.704157 run osmo-hlr_10.42.42.2(pid=17813): stdout: | (launched: 2022-12-14_11:46:11.575675) 11:46:14.756701 run osmo-hlr_10.42.42.2(pid=17813): stderr: | [0;m[1;31m20221214114611774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114611774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114611774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114611774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114611774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114611774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114611787 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114611796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114611796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114611796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:14.829964 run osmo-msc_10.42.42.6(pid=17819): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17819)] 11:46:14.880481 run osmo-msc_10.42.42.6(pid=17819): stdout: | (launched: 2022-12-14_11:46:13.663662) 11:46:14.932855 run osmo-msc_10.42.42.6(pid=17819): stderr: | [0;m[38;5;43m20221214114613988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114613989 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2beac49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114613989 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114613989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114613989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114613989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114613991 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114613991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114613991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114613992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:14.985874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17812): Terminating (SIGTERM) 11:46:15.028422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17815): Terminating (SIGTERM) 11:46:15.070895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17818): Terminating (SIGTERM) 11:46:15.113477 --- ParallelTerminationStrategy: PID 17812 died... 11:46:15.133871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17812): Terminated: ok {rc=0} 11:46:15.180692 --- ParallelTerminationStrategy: PID 17815 died... 11:46:15.200571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17815): Terminated: ok {rc=0} 11:46:15.247242 --- ParallelTerminationStrategy: PID 17818 died... 11:46:15.267280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17818): Terminated: ok {rc=0} 11:46:15.357139 bus /sierra_3: Setting Powered False 11:46:16.455194 bus /sierra_3: Setting Powered False 11:46:17.573706 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:46:18.824337 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:46:18.830948 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:46:18.863500 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:46:18.890830 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:46:18.943016 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:46:18.978318 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:46:19.006948 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:46:19.557866 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:46:19.609447 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:19.620774 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:46:19.690245 tst mo_mt_call.py: using LAC 40677 11:46:19.811257 tst mo_mt_call.py: using RAC 132 11:46:19.934874 tst mo_mt_call.py: using CellId 40677 11:46:20.058815 tst mo_mt_call.py: using BVCI 40678 11:46:20.173440 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:20.184551 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:20.195632 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:20.206662 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:20.217999 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:20.229274 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:46:20.347780 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:46:20.469673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:20.982010 run create_hlr_db(pid=17824): Launched 11:46:21.118498 bus /sierra_2: Setting Powered False 11:46:22.183481 run create_hlr_db(pid=17824): Terminated: ok {rc=0} 11:46:22.641698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17826): Launched 11:46:22.973560 run osmo-hlr_10.42.42.2(pid=17827): Launched 11:46:23.098746 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:23.670204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17829): Launched 11:46:23.999957 run osmo-stp_10.42.42.5(pid=17830): Launched 11:46:24.127064 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:24.723096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17832): Launched 11:46:25.055136 run osmo-msc_10.42.42.6(pid=17833): Launched 11:46:25.240016 run osmo-stp_10.42.42.5(pid=17830): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17830)] 11:46:25.379179 run osmo-stp_10.42.42.5(pid=17830): stdout: | (launched: 2022-12-14_11:46:23.938635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:25.517981 run osmo-stp_10.42.42.5(pid=17830): stderr: | [0;m[38;5;43m20221214114624131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114624132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114624132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114624132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114624133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114624133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114624133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:25.655263 run osmo-stp_10.42.42.5(pid=17830): stdout: | (launched: 2022-12-14_11:46:23.938635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:25.786269 run osmo-stp_10.42.42.5(pid=17830): stderr: | [0;m[38;5;43m20221214114624131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114624132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114624132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114624132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114624133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114624133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114624133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:25.942591 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17830): Process ended prematurely: osmo-stp_10.42.42.5(pid=17830) [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17830)] [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:46:25.952229 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:46:25.980240 run osmo-hlr_10.42.42.2(pid=17827): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17827)] 11:46:26.030720 run osmo-hlr_10.42.42.2(pid=17827): stdout: | (launched: 2022-12-14_11:46:22.912303) 11:46:26.082976 run osmo-hlr_10.42.42.2(pid=17827): stderr: | [0;m[1;31m20221214114623110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114623110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114623110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114623110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114623110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114623111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114623124 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114623132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114623132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114623132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:26.155148 run osmo-msc_10.42.42.6(pid=17833): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17833)] 11:46:26.204851 run osmo-msc_10.42.42.6(pid=17833): stdout: | (launched: 2022-12-14_11:46:24.993881) 11:46:26.256505 run osmo-msc_10.42.42.6(pid=17833): stderr: | [0;m[38;5;43m20221214114625314 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114625314 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ae2d25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114625315 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114625315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114625315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114625315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114625317 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114625317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114625317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114625317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:26.308793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17826): Terminating (SIGTERM) 11:46:26.350625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17829): Terminating (SIGTERM) 11:46:26.392262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17832): Terminating (SIGTERM) 11:46:26.434089 --- ParallelTerminationStrategy: PID 17826 died... 11:46:26.454077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17826): Terminated: ok {rc=0} 11:46:26.499713 --- ParallelTerminationStrategy: PID 17829 died... 11:46:26.519227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17829): Terminated: ok {rc=0} 11:46:26.565097 --- ParallelTerminationStrategy: PID 17832 died... 11:46:26.584526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17832): Terminated: ok {rc=0} 11:46:26.673254 bus /sierra_3: Setting Powered False 11:46:27.773285 bus /sierra_3: Setting Powered False 11:46:28.890184 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:46:30.041085 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:30.053758 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:46:30.126929 tst mo_mt_call_osmux.py: using LAC 40678 11:46:30.257775 tst mo_mt_call_osmux.py: using RAC 133 11:46:30.388823 tst mo_mt_call_osmux.py: using CellId 40678 11:46:30.518514 tst mo_mt_call_osmux.py: using BVCI 40679 11:46:30.639266 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:30.651011 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:30.663089 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:30.674729 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:30.686531 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:46:30.698253 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:46:30.817931 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:46:30.960392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:31.467164 run create_hlr_db(pid=17835): Launched 11:46:31.629928 bus /sierra_2: Setting Powered False 11:46:32.691154 run create_hlr_db(pid=17835): Terminated: ok {rc=0} 11:46:33.145644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17837): Launched 11:46:33.477222 run osmo-hlr_10.42.42.2(pid=17838): Launched 11:46:33.603769 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:34.178934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17840): Launched 11:46:34.508837 run osmo-stp_10.42.42.5(pid=17841): Launched 11:46:34.635903 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:35.232843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17843): Launched 11:46:35.564412 run osmo-msc_10.42.42.6(pid=17844): Launched 11:46:35.748231 run osmo-stp_10.42.42.5(pid=17841): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17841)] 11:46:35.887249 run osmo-stp_10.42.42.5(pid=17841): stdout: | (launched: 2022-12-14_11:46:34.448071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:36.028495 run osmo-stp_10.42.42.5(pid=17841): stderr: | [0;m[38;5;43m20221214114634643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114634643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114634643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114634644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114634644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114634644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114634644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:36.166934 run osmo-stp_10.42.42.5(pid=17841): stdout: | (launched: 2022-12-14_11:46:34.448071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:36.297541 run osmo-stp_10.42.42.5(pid=17841): stderr: | [0;m[38;5;43m20221214114634643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114634643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114634643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114634644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114634644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114634644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114634644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:36.454436 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17841): Process ended prematurely: osmo-stp_10.42.42.5(pid=17841) [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17841)] [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:46:36.464209 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:46:36.492031 run osmo-hlr_10.42.42.2(pid=17838): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17838)] 11:46:36.542143 run osmo-hlr_10.42.42.2(pid=17838): stdout: | (launched: 2022-12-14_11:46:33.416047) 11:46:36.594242 run osmo-hlr_10.42.42.2(pid=17838): stderr: | [0;m[1;31m20221214114633616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114633616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114633616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114633617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114633617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114633617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114633630 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114633638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114633638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114633638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:36.666796 run osmo-msc_10.42.42.6(pid=17844): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17844)] 11:46:36.716902 run osmo-msc_10.42.42.6(pid=17844): stdout: | (launched: 2022-12-14_11:46:35.502560) 11:46:36.768647 run osmo-msc_10.42.42.6(pid=17844): stderr: | [0;m[38;5;43m20221214114635823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114635824 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71b2e4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114635824 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114635824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114635824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114635824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114635826 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114635826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114635826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114635826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:36.820697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17837): Terminating (SIGTERM) 11:46:36.862535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17840): Terminating (SIGTERM) 11:46:36.904895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17843): Terminating (SIGTERM) 11:46:36.947198 --- ParallelTerminationStrategy: PID 17837 died... 11:46:36.967435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17837): Terminated: ok {rc=0} 11:46:37.013882 --- ParallelTerminationStrategy: PID 17840 died... 11:46:37.033538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17840): Terminated: ok {rc=0} 11:46:37.079648 --- ParallelTerminationStrategy: PID 17843 died... 11:46:37.099429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17843): Terminated: ok {rc=0} 11:46:37.188213 bus /sierra_3: Setting Powered False 11:46:38.287319 bus /sierra_3: Setting Powered False 11:46:39.403624 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:46:40.657593 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:46:40.664173 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:46:40.697959 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:46:40.725834 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:46:40.779837 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:46:40.813891 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:46:40.841353 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:46:41.386714 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:46:41.436568 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:41.447581 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:46:41.517400 tst mo_mt_call.py: using LAC 40679 11:46:41.639743 tst mo_mt_call.py: using RAC 134 11:46:41.762165 tst mo_mt_call.py: using CellId 40679 11:46:41.884458 tst mo_mt_call.py: using BVCI 40680 11:46:41.998077 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:42.008893 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:42.019680 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:42.030472 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:42.041682 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:42.052645 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:46:42.175404 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:46:42.297317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:42.810790 run create_hlr_db(pid=17849): Launched 11:46:42.944560 bus /sierra_2: Setting Powered False 11:46:44.010002 run create_hlr_db(pid=17849): Terminated: ok {rc=0} 11:46:44.472003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17851): Launched 11:46:44.804923 run osmo-hlr_10.42.42.2(pid=17852): Launched 11:46:44.929768 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:45.500367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17854): Launched 11:46:45.834716 run osmo-stp_10.42.42.5(pid=17855): Launched 11:46:46.023459 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:46.765868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17857): Launched 11:46:47.100495 run osmo-msc_10.42.42.6(pid=17858): Launched 11:46:47.363647 run osmo-stp_10.42.42.5(pid=17855): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17855)] 11:46:47.501882 run osmo-stp_10.42.42.5(pid=17855): stdout: | (launched: 2022-12-14_11:46:45.771205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:47.640640 run osmo-stp_10.42.42.5(pid=17855): stderr: | [0;m[38;5;43m20221214114646098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114646098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114646099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114646099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114646099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114646100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114646100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:47.779130 run osmo-stp_10.42.42.5(pid=17855): stdout: | (launched: 2022-12-14_11:46:45.771205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:47.909805 run osmo-stp_10.42.42.5(pid=17855): stderr: | [0;m[38;5;43m20221214114646098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114646098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114646099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114646099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114646099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114646100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114646100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:48.067294 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17855): Process ended prematurely: osmo-stp_10.42.42.5(pid=17855) [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17855)] [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:46:48.077066 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 11:46:48.105142 run osmo-hlr_10.42.42.2(pid=17852): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17852)] 11:46:48.155610 run osmo-hlr_10.42.42.2(pid=17852): stdout: | (launched: 2022-12-14_11:46:44.743345) 11:46:48.207754 run osmo-hlr_10.42.42.2(pid=17852): stderr: | [0;m[1;31m20221214114644942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114644942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114644942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114644942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114644942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114644942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114644955 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114644964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114644964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114644964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:48.280755 run osmo-msc_10.42.42.6(pid=17858): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17858)] 11:46:48.331130 run osmo-msc_10.42.42.6(pid=17858): stdout: | (launched: 2022-12-14_11:46:47.041153) 11:46:48.383073 run osmo-msc_10.42.42.6(pid=17858): stderr: | [0;m[38;5;43m20221214114647458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114647458 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e88fb1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114647458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114647458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114647458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114647459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114647460 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114647461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114647461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114647461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:48.435311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17851): Terminating (SIGTERM) 11:46:48.477546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17854): Terminating (SIGTERM) 11:46:48.520273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17857): Terminating (SIGTERM) 11:46:48.563088 --- ParallelTerminationStrategy: PID 17851 died... 11:46:48.583476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17851): Terminated: ok {rc=0} 11:46:48.630394 --- ParallelTerminationStrategy: PID 17854 died... 11:46:48.650165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17854): Terminated: ok {rc=0} 11:46:48.696630 --- ParallelTerminationStrategy: PID 17857 died... 11:46:48.716544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17857): Terminated: ok {rc=0} 11:46:48.806271 bus /sierra_3: Setting Powered False 11:46:49.906472 bus /sierra_3: Setting Powered False 11:46:51.023545 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:46:52.174410 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:52.186630 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:46:52.259785 tst mo_mt_call_osmux.py: using LAC 40680 11:46:52.391390 tst mo_mt_call_osmux.py: using RAC 135 11:46:52.514429 tst mo_mt_call_osmux.py: using CellId 40680 11:46:52.637399 tst mo_mt_call_osmux.py: using BVCI 40681 11:46:52.749496 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:52.760491 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:52.771605 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:52.782566 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:52.793659 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:46:52.804781 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:46:52.922973 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:46:53.044887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:53.558224 run create_hlr_db(pid=17860): Launched 11:46:53.692469 bus /sierra_2: Setting Powered False 11:46:54.758137 run create_hlr_db(pid=17860): Terminated: ok {rc=0} 11:46:55.200255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17863): Launched 11:46:55.510736 run osmo-hlr_10.42.42.2(pid=17864): Launched 11:46:55.629569 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:56.172903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17866): Launched 11:46:56.483629 run osmo-stp_10.42.42.5(pid=17867): Launched 11:46:56.603631 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:57.163376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17869): Launched 11:46:57.474602 run osmo-msc_10.42.42.6(pid=17870): Launched 11:46:57.650471 run osmo-stp_10.42.42.5(pid=17867): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17867)] 11:46:57.781606 run osmo-stp_10.42.42.5(pid=17867): stdout: | (launched: 2022-12-14_11:46:56.425916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:57.912409 run osmo-stp_10.42.42.5(pid=17867): stderr: | [0;m[38;5;43m20221214114656596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114656596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114656596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114656597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114656597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114656598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114656598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:58.041746 run osmo-stp_10.42.42.5(pid=17867): stdout: | (launched: 2022-12-14_11:46:56.425916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:58.164331 run osmo-stp_10.42.42.5(pid=17867): stderr: | [0;m[38;5;43m20221214114656596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114656596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114656596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114656597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114656597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114656598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114656598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:58.311628 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17867): Process ended prematurely: osmo-stp_10.42.42.5(pid=17867) [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17867)] [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:46:58.320815 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:46:58.347652 run osmo-hlr_10.42.42.2(pid=17864): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17864)] 11:46:58.396703 run osmo-hlr_10.42.42.2(pid=17864): stdout: | (launched: 2022-12-14_11:46:55.453369) 11:46:58.447014 run osmo-hlr_10.42.42.2(pid=17864): stderr: | [0;m[1;31m20221214114655630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114655630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114655630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114655630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114655630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114655630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114655642 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114655650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114655650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114655650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:58.517228 run osmo-msc_10.42.42.6(pid=17870): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17870)] 11:46:58.565435 run osmo-msc_10.42.42.6(pid=17870): stdout: | (launched: 2022-12-14_11:46:57.416868) 11:46:58.615559 run osmo-msc_10.42.42.6(pid=17870): stderr: | [0;m[38;5;43m20221214114657687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114657687 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa4d947c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114657687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114657687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114657688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114657688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114657690 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114657690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114657690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114657690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:58.666119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17863): Terminating (SIGTERM) 11:46:58.706651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17866): Terminating (SIGTERM) 11:46:58.747061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17869): Terminating (SIGTERM) 11:46:58.788378 --- ParallelTerminationStrategy: PID 17863 died... 11:46:58.810602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17863): Terminated: ok {rc=0} 11:46:58.857317 --- ParallelTerminationStrategy: PID 17866 died... 11:46:58.877370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17866): Terminated: ok {rc=0} 11:46:58.923945 --- ParallelTerminationStrategy: PID 17869 died... 11:46:58.944040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17869): Terminated: ok {rc=0} 11:46:59.033868 bus /sierra_3: Setting Powered False 11:47:00.133793 bus /sierra_3: Setting Powered False 11:47:01.249573 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 11:47:02.503835 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:47:02.508924 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 11:47:02.541481 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 11:47:02.570142 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 11:47:02.620214 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 11:47:02.653044 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 11:47:02.679707 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 11:47:03.230722 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 11:47:03.280616 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:03.291676 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 11:47:03.345586 tst mo_mt_call.py: using LAC 40681 11:47:03.466546 tst mo_mt_call.py: using RAC 136 11:47:03.587155 tst mo_mt_call.py: using CellId 40681 11:47:03.707200 tst mo_mt_call.py: using BVCI 40682 11:47:03.819383 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:03.830628 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:03.841633 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:03.852244 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:03.863250 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:03.874407 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:47:03.996154 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:47:04.115612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:04.595462 run create_hlr_db(pid=17875): Launched 11:47:04.714571 bus /sierra_2: Setting Powered False 11:47:05.775976 run create_hlr_db(pid=17875): Terminated: ok {rc=0} 11:47:06.207215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17877): Launched 11:47:06.517018 run osmo-hlr_10.42.42.2(pid=17878): Launched 11:47:06.634774 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:07.180706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17880): Launched 11:47:07.490500 run osmo-stp_10.42.42.5(pid=17881): Launched 11:47:07.608699 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:08.168272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17883): Launched 11:47:08.479326 run osmo-msc_10.42.42.6(pid=17884): Launched 11:47:08.652742 run osmo-stp_10.42.42.5(pid=17881): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17881)] 11:47:08.783831 run osmo-stp_10.42.42.5(pid=17881): stdout: | (launched: 2022-12-14_11:47:07.432943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:08.915145 run osmo-stp_10.42.42.5(pid=17881): stderr: | [0;m[38;5;43m20221214114707605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114707605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114707605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114707606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114707606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114707606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114707606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:09.043637 run osmo-stp_10.42.42.5(pid=17881): stdout: | (launched: 2022-12-14_11:47:07.432943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:09.166288 run osmo-stp_10.42.42.5(pid=17881): stderr: | [0;m[38;5;43m20221214114707605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114707605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114707605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114707606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114707606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114707606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114707606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:09.312759 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17881): Process ended prematurely: osmo-stp_10.42.42.5(pid=17881) [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17881)] [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 11:47:09.321831 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:47:09.348080 run osmo-hlr_10.42.42.2(pid=17878): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17878)] 11:47:09.396552 run osmo-hlr_10.42.42.2(pid=17878): stdout: | (launched: 2022-12-14_11:47:06.459719) 11:47:09.446333 run osmo-hlr_10.42.42.2(pid=17878): stderr: | [0;m[1;31m20221214114706637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114706637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114706637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114706637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114706637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114706637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114706649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114706657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114706658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114706658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:09.515857 run osmo-msc_10.42.42.6(pid=17884): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17884)] 11:47:09.563726 run osmo-msc_10.42.42.6(pid=17884): stdout: | (launched: 2022-12-14_11:47:08.421878) 11:47:09.613374 run osmo-msc_10.42.42.6(pid=17884): stderr: | [0;m[38;5;43m20221214114708693 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114708693 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44011bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114708693 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114708693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114708694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114708694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114708695 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114708696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114708696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114708696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:09.663745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17877): Terminating (SIGTERM) 11:47:09.704079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17880): Terminating (SIGTERM) 11:47:09.744425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17883): Terminating (SIGTERM) 11:47:09.785199 --- ParallelTerminationStrategy: PID 17877 died... 11:47:09.804761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17877): Terminated: ok {rc=0} 11:47:09.849592 --- ParallelTerminationStrategy: PID 17880 died... 11:47:09.868691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17880): Terminated: ok {rc=0} 11:47:09.913274 --- ParallelTerminationStrategy: PID 17883 died... 11:47:09.932475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17883): Terminated: ok {rc=0} 11:47:10.020070 bus /sierra_3: Setting Powered False 11:47:11.121891 bus /sierra_3: Setting Powered False 11:47:12.241579 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 11:47:13.390728 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:13.402352 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 11:47:13.452510 tst mo_mt_call_osmux.py: using LAC 40682 11:47:13.572824 tst mo_mt_call_osmux.py: using RAC 137 11:47:13.694332 tst mo_mt_call_osmux.py: using CellId 40682 11:47:13.817302 tst mo_mt_call_osmux.py: using BVCI 40683 11:47:13.931028 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:13.942667 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:13.953632 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:13.964473 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:13.975709 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:47:13.986982 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:47:14.108508 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:47:14.226843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:14.706460 run create_hlr_db(pid=17886): Launched 11:47:14.825668 bus /sierra_2: Setting Powered False 11:47:15.913387 run create_hlr_db(pid=17886): Terminated: ok {rc=0} 11:47:16.378730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17888): Launched 11:47:16.728414 run osmo-hlr_10.42.42.2(pid=17889): Launched 11:47:16.981722 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:17.621551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17891): Launched 11:47:17.953745 run osmo-stp_10.42.42.5(pid=17892): Launched 11:47:18.080040 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:18.680514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17894): Launched 11:47:19.013284 run osmo-msc_10.42.42.6(pid=17895): Launched 11:47:19.198327 run osmo-stp_10.42.42.5(pid=17892): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17892)] 11:47:19.336752 run osmo-stp_10.42.42.5(pid=17892): stdout: | (launched: 2022-12-14_11:47:17.892827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:19.476048 run osmo-stp_10.42.42.5(pid=17892): stderr: | [0;m[38;5;43m20221214114718084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114718084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114718084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114718085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114718085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114718085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114718085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:19.613961 run osmo-stp_10.42.42.5(pid=17892): stdout: | (launched: 2022-12-14_11:47:17.892827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:19.744654 run osmo-stp_10.42.42.5(pid=17892): stderr: | [0;m[38;5;43m20221214114718084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114718084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114718084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114718085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114718085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114718085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114718085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:19.901120 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17892): Process ended prematurely: osmo-stp_10.42.42.5(pid=17892) [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17892)] [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 11:47:19.910717 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:47:19.938172 run osmo-hlr_10.42.42.2(pid=17889): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17889)] 11:47:19.988551 run osmo-hlr_10.42.42.2(pid=17889): stdout: | (launched: 2022-12-14_11:47:16.666941) 11:47:20.040922 run osmo-hlr_10.42.42.2(pid=17889): stderr: | [0;m[1;31m20221214114716972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114716972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114716972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114716972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114716972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114716972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114716993 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114717004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114717004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114717004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:20.113433 run osmo-msc_10.42.42.6(pid=17895): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17895)] 11:47:20.163501 run osmo-msc_10.42.42.6(pid=17895): stdout: | (launched: 2022-12-14_11:47:18.951767) 11:47:20.215232 run osmo-msc_10.42.42.6(pid=17895): stderr: | [0;m[38;5;43m20221214114719274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114719274 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c2e6e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114719274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114719274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114719275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114719275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114719276 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114719277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114719277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114719277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:20.267256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17888): Terminating (SIGTERM) 11:47:20.308829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17891): Terminating (SIGTERM) 11:47:20.351069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17894): Terminating (SIGTERM) 11:47:20.393021 --- ParallelTerminationStrategy: PID 17888 died... 11:47:20.412930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17888): Terminated: ok {rc=0} 11:47:20.459289 --- ParallelTerminationStrategy: PID 17891 died... 11:47:20.478930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17891): Terminated: ok {rc=0} 11:47:20.525389 --- ParallelTerminationStrategy: PID 17894 died... 11:47:20.544877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17894): Terminated: ok {rc=0} 11:47:20.633244 bus /sierra_3: Setting Powered False 11:47:21.733089 bus /sierra_3: Setting Powered False 11:47:22.850756 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:47:24.098735 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:47:24.104740 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:47:24.137773 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 11:47:24.165207 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 11:47:24.218620 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:47:24.252145 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 11:47:24.279088 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 11:47:24.830694 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 11:47:24.880732 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:24.892224 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:47:24.944282 tst mo_mt_call.py: using LAC 40683 11:47:25.072364 tst mo_mt_call.py: using RAC 138 11:47:25.193398 tst mo_mt_call.py: using CellId 40683 11:47:25.314259 tst mo_mt_call.py: using BVCI 40684 11:47:25.428618 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:25.440113 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:25.451460 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:25.462826 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:25.474353 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:25.485785 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:47:25.608599 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:47:25.728305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:26.210290 run create_hlr_db(pid=17901): Launched 11:47:26.330560 bus /sierra_2: Setting Powered False 11:47:27.391742 run create_hlr_db(pid=17901): Terminated: ok {rc=0} 11:47:27.825496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17903): Launched 11:47:28.135980 run osmo-hlr_10.42.42.2(pid=17904): Launched 11:47:28.254841 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:28.786910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17906): Launched 11:47:29.096311 run osmo-stp_10.42.42.5(pid=17907): Launched 11:47:29.215062 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:29.774342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17909): Launched 11:47:30.086185 run osmo-msc_10.42.42.6(pid=17910): Launched 11:47:30.261105 run osmo-stp_10.42.42.5(pid=17907): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17907)] 11:47:30.392164 run osmo-stp_10.42.42.5(pid=17907): stdout: | (launched: 2022-12-14_11:47:29.038889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:30.523031 run osmo-stp_10.42.42.5(pid=17907): stderr: | [0;m[38;5;43m20221214114729210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114729211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114729211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114729211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114729212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114729212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114729212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:30.652299 run osmo-stp_10.42.42.5(pid=17907): stdout: | (launched: 2022-12-14_11:47:29.038889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:30.774905 run osmo-stp_10.42.42.5(pid=17907): stderr: | [0;m[38;5;43m20221214114729210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114729211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114729211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114729211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114729212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114729212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114729212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:30.939011 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17907): Process ended prematurely: osmo-stp_10.42.42.5(pid=17907) [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17907)] [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 11:47:30.949268 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:47:30.977115 run osmo-hlr_10.42.42.2(pid=17904): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17904)] 11:47:31.029212 run osmo-hlr_10.42.42.2(pid=17904): stdout: | (launched: 2022-12-14_11:47:28.078451) 11:47:31.081523 run osmo-hlr_10.42.42.2(pid=17904): stderr: | [0;m[1;31m20221214114728253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114728253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114728253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114728253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114728253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114728253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114728265 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114728273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114728274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114728274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:31.153808 run osmo-msc_10.42.42.6(pid=17910): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17910)] 11:47:31.203377 run osmo-msc_10.42.42.6(pid=17910): stdout: | (launched: 2022-12-14_11:47:30.028437) 11:47:31.255612 run osmo-msc_10.42.42.6(pid=17910): stderr: | [0;m[38;5;43m20221214114730297 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114730297 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d1bdd7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114730297 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114730297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114730298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114730298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114730299 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114730300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114730300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114730300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:31.307925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17903): Terminating (SIGTERM) 11:47:31.349842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17906): Terminating (SIGTERM) 11:47:31.392162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17909): Terminating (SIGTERM) 11:47:31.434462 --- ParallelTerminationStrategy: PID 17903 died... 11:47:31.455031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17903): Terminated: ok {rc=0} 11:47:31.501510 --- ParallelTerminationStrategy: PID 17906 died... 11:47:31.521978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17906): Terminated: ok {rc=0} 11:47:31.568243 --- ParallelTerminationStrategy: PID 17909 died... 11:47:31.588878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17909): Terminated: ok {rc=0} 11:47:31.678347 bus /sierra_3: Setting Powered False 11:47:32.775452 bus /sierra_3: Setting Powered False 11:47:33.893272 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 11:47:35.044166 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:35.056856 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:47:35.111229 tst mo_mt_call_osmux.py: using LAC 40684 11:47:35.241203 tst mo_mt_call_osmux.py: using RAC 139 11:47:35.372701 tst mo_mt_call_osmux.py: using CellId 40684 11:47:35.503271 tst mo_mt_call_osmux.py: using BVCI 40685 11:47:35.624779 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:35.636666 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:35.648460 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:35.660162 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:35.671994 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:47:35.683730 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:47:35.802267 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:47:35.929570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:36.443070 run create_hlr_db(pid=17912): Launched 11:47:36.576392 bus /sierra_2: Setting Powered False 11:47:37.641515 run create_hlr_db(pid=17912): Terminated: ok {rc=0} 11:47:38.082423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17914): Launched 11:47:38.391835 run osmo-hlr_10.42.42.2(pid=17915): Launched 11:47:38.510867 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:39.052901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17917): Launched 11:47:39.361332 run osmo-stp_10.42.42.5(pid=17918): Launched 11:47:39.479284 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:40.037655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17920): Launched 11:47:40.346700 run osmo-msc_10.42.42.6(pid=17921): Launched 11:47:40.518831 run osmo-stp_10.42.42.5(pid=17918): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17918)] 11:47:40.649494 run osmo-stp_10.42.42.5(pid=17918): stdout: | (launched: 2022-12-14_11:47:39.303625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:40.779993 run osmo-stp_10.42.42.5(pid=17918): stderr: | [0;m[38;5;43m20221214114739473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114739473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114739473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114739474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114739474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114739474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114739474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:40.908052 run osmo-stp_10.42.42.5(pid=17918): stdout: | (launched: 2022-12-14_11:47:39.303625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:41.030271 run osmo-stp_10.42.42.5(pid=17918): stderr: | [0;m[38;5;43m20221214114739473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114739473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114739473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114739474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114739474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114739474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114739474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:41.176366 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17918): Process ended prematurely: osmo-stp_10.42.42.5(pid=17918) [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17918)] [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 11:47:41.185439 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:47:41.211723 run osmo-hlr_10.42.42.2(pid=17915): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17915)] 11:47:41.259915 run osmo-hlr_10.42.42.2(pid=17915): stdout: | (launched: 2022-12-14_11:47:38.334062) 11:47:41.309650 run osmo-hlr_10.42.42.2(pid=17915): stderr: | [0;m[1;31m20221214114738511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114738511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114738511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114738511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114738511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114738511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114738528 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114738539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114738539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114738539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:41.379293 run osmo-msc_10.42.42.6(pid=17921): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17921)] 11:47:41.426655 run osmo-msc_10.42.42.6(pid=17921): stdout: | (launched: 2022-12-14_11:47:40.288858) 11:47:41.475917 run osmo-msc_10.42.42.6(pid=17921): stderr: | [0;m[38;5;43m20221214114740560 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114740560 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa580b14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114740560 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114740560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114740560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114740560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114740562 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114740563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114740563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114740563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:41.525857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17914): Terminating (SIGTERM) 11:47:41.565880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17917): Terminating (SIGTERM) 11:47:41.605919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17920): Terminating (SIGTERM) 11:47:41.646151 --- ParallelTerminationStrategy: PID 17914 died... 11:47:41.665699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17914): Terminated: ok {rc=0} 11:47:41.709783 --- ParallelTerminationStrategy: PID 17917 died... 11:47:41.728467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17917): Terminated: ok {rc=0} 11:47:41.772499 --- ParallelTerminationStrategy: PID 17920 died... 11:47:41.791406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17920): Terminated: ok {rc=0} 11:47:41.877429 bus /sierra_3: Setting Powered False 11:47:42.979205 bus /sierra_3: Setting Powered False 11:47:44.094873 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 emergency:trx-b200 --------------------------------------------------------------------- 11:47:45.348362 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:47:45.353301 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 11:47:45.387146 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:47:45.414814 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 11:47:45.501648 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 11:47:45.535948 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:47:45.563571 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 11:47:46.146987 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2404 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 11:47:46.156011 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:46.170034 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 11:47:46.233339 tst emergency_mo_mt_call.py: using LAC 40685 11:47:46.365659 tst emergency_mo_mt_call.py: using RAC 140 11:47:46.492504 tst emergency_mo_mt_call.py: using CellId 40685 11:47:46.652212 tst emergency_mo_mt_call.py: using BVCI 40686 11:47:46.814317 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:46.829845 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:46.843648 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:46.858510 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:46.875552 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:46.892110 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:47:47.021411 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:47:47.172255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:47.657229 run create_hlr_db(pid=17926): Launched 11:47:47.775120 bus /sierra_2: Setting Powered False 11:47:48.836368 run create_hlr_db(pid=17926): Terminated: ok {rc=0} 11:47:49.282412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17928): Launched 11:47:49.607509 run osmo-hlr_10.42.42.2(pid=17929): Launched 11:47:49.731592 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:50.295370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17931): Launched 11:47:50.621157 run osmo-stp_10.42.42.5(pid=17932): Launched 11:47:50.755532 tst emergency_mo_mt_call.py: using MSISDN 8669 11:47:50.919888 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:51.504499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17934): Launched 11:47:51.831079 run osmo-msc_10.42.42.6(pid=17935): Launched 11:47:52.025138 run osmo-stp_10.42.42.5(pid=17932): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17932)] 11:47:52.162743 run osmo-stp_10.42.42.5(pid=17932): stdout: | (launched: 2022-12-14_11:47:50.560916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:52.300663 run osmo-stp_10.42.42.5(pid=17932): stderr: | [0;m[38;5;43m20221214114750755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114750755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114750756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114750756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114750756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114750757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114750757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:52.436731 run osmo-stp_10.42.42.5(pid=17932): stdout: | (launched: 2022-12-14_11:47:50.560916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:52.565786 run osmo-stp_10.42.42.5(pid=17932): stderr: | [0;m[38;5;43m20221214114750755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114750755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114750756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114750756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114750756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114750757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114750757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:52.719853 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17932): Process ended prematurely: osmo-stp_10.42.42.5(pid=17932) [trial-2404↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17932)] [trial-2404↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 11:47:52.729166 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 11:47:52.757182 run osmo-hlr_10.42.42.2(pid=17929): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17929)] 11:47:52.807888 run osmo-hlr_10.42.42.2(pid=17929): stdout: | (launched: 2022-12-14_11:47:49.547382) 11:47:52.860223 run osmo-hlr_10.42.42.2(pid=17929): stderr: | [0;m[1;31m20221214114749745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114749745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114749745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114749745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114749745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114749745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114749757 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114749765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114749766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114749766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:52.933351 run osmo-msc_10.42.42.6(pid=17935): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17935)] 11:47:52.983534 run osmo-msc_10.42.42.6(pid=17935): stdout: | (launched: 2022-12-14_11:47:51.770957) 11:47:53.035736 run osmo-msc_10.42.42.6(pid=17935): stderr: | [0;m[38;5;43m20221214114752144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114752144 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f23393e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114752144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114752144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114752144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114752144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114752146 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114752147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114752147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114752147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:53.087816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17928): Terminating (SIGTERM) 11:47:53.129818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17931): Terminating (SIGTERM) 11:47:53.171648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17934): Terminating (SIGTERM) 11:47:53.213984 --- ParallelTerminationStrategy: PID 17928 died... 11:47:53.234384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17928): Terminated: ok {rc=0} 11:47:53.280648 --- ParallelTerminationStrategy: PID 17931 died... 11:47:53.300190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17931): Terminated: ok {rc=0} 11:47:53.346453 --- ParallelTerminationStrategy: PID 17934 died... 11:47:53.366205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17934): Terminated: ok {rc=0} 11:47:53.454832 bus /sierra_3: Setting Powered False 11:47:54.553884 bus /sierra_3: Setting Powered False 11:47:55.669352 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 11:47:56.756933 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:56.769173 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 11:47:56.822055 tst emergency_preemptive_call.py: using LAC 40686 11:47:56.949187 tst emergency_preemptive_call.py: using RAC 141 11:47:57.076642 tst emergency_preemptive_call.py: using CellId 40686 11:47:57.203511 tst emergency_preemptive_call.py: using BVCI 40687 11:47:57.322285 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:57.333622 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:57.344618 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:57.355691 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:57.366728 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:47:57.377764 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:47:57.496094 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:47:57.618591 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:47:57.739599 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:47:57.858781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:58.364468 run create_hlr_db(pid=17937): Launched 11:47:58.496703 bus /sierra_2: Setting Powered False 11:47:59.561515 run create_hlr_db(pid=17937): Terminated: ok {rc=0} 11:47:59.997230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17939): Launched 11:48:00.299854 run osmo-hlr_10.42.42.2(pid=17940): Launched 11:48:00.415188 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:00.965367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17942): Launched 11:48:01.312568 run osmo-stp_10.42.42.5(pid=17943): Launched 11:48:01.611424 tst emergency_preemptive_call.py: using MSISDN 8670 11:48:01.770217 run osmo-msc_10.42.42.6: Starting osmo-msc 11:48:02.323835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17945): Launched 11:48:02.627450 run osmo-msc_10.42.42.6(pid=17946): Launched 11:48:02.798286 run osmo-stp_10.42.42.5(pid=17943): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17943)] 11:48:02.926854 run osmo-stp_10.42.42.5(pid=17943): stdout: | (launched: 2022-12-14_11:48:01.252139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:03.055709 run osmo-stp_10.42.42.5(pid=17943): stderr: | [0;m[38;5;43m20221214114801453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114801453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114801453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114801454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114801454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114801454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114801454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:03.182246 run osmo-stp_10.42.42.5(pid=17943): stdout: | (launched: 2022-12-14_11:48:01.252139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:03.302535 run osmo-stp_10.42.42.5(pid=17943): stderr: | [0;m[38;5;43m20221214114801453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114801453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114801453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114801454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114801454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114801454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114801454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:03.446532 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17943): Process ended prematurely: osmo-stp_10.42.42.5(pid=17943) [trial-2404↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17943)] [trial-2404↪emergency:trx-b200↪emergency_preemptive_call.py:32] 11:48:03.455039 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 11:48:03.481443 run osmo-hlr_10.42.42.2(pid=17940): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17940)] 11:48:03.530291 run osmo-hlr_10.42.42.2(pid=17940): stdout: | (launched: 2022-12-14_11:48:00.243540) 11:48:03.580552 run osmo-hlr_10.42.42.2(pid=17940): stderr: | [0;m[1;31m20221214114800419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114800419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114800419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114800419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114800419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114800419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114800431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114800440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114800440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114800440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:03.650952 run osmo-msc_10.42.42.6(pid=17946): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17946)] 11:48:03.698966 run osmo-msc_10.42.42.6(pid=17946): stdout: | (launched: 2022-12-14_11:48:02.570734) 11:48:03.748590 run osmo-msc_10.42.42.6(pid=17946): stderr: | [0;m[38;5;43m20221214114802840 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214114802840 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8b0cd64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214114802840 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214114802840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214114802840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214114802840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214114802842 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214114802843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214114802843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214114802843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:48:03.798843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17939): Terminating (SIGTERM) 11:48:03.839583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17942): Terminating (SIGTERM) 11:48:03.880726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17945): Terminating (SIGTERM) 11:48:03.921808 --- ParallelTerminationStrategy: PID 17939 died... 11:48:03.941618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17939): Terminated: ok {rc=0} 11:48:03.986423 --- ParallelTerminationStrategy: PID 17942 died... 11:48:04.005501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17942): Terminated: ok {rc=0} 11:48:04.050363 --- ParallelTerminationStrategy: PID 17945 died... 11:48:04.069679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17945): Terminated: ok {rc=0} 11:48:04.157340 bus /sierra_9: Setting Powered False 11:48:05.257572 bus /sierra_9: Setting Powered False 11:48:06.374315 bus /sierra_8: Setting Powered False 11:48:07.474101 bus /sierra_8: Setting Powered False 11:48:08.594011 bus /sierra_3: Setting Powered False 11:48:09.694007 bus /sierra_3: Setting Powered False 11:48:10.814506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-b200 --------------------------------------------------------------------- 11:48:12.094775 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:48:12.099174 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 11:48:12.131770 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 11:48:12.170600 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 11:48:12.258293 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 11:48:12.292160 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 11:48:12.330361 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 11:48:12.917932 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 11:48:12.968943 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:12.979574 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:48:13.029428 tst cs_paging_gprs_active.py: using LAC 40687 11:48:13.161453 tst cs_paging_gprs_active.py: using RAC 142 11:48:13.283143 tst cs_paging_gprs_active.py: using CellId 40687 11:48:13.406840 tst cs_paging_gprs_active.py: using BVCI 40688 11:48:13.522196 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:13.532801 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:13.543339 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:13.553751 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:13.565144 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:13.576213 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:13.587539 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:13.598720 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:13.609997 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:48:13.733749 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:48:13.855564 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:48:14.080888 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:14.415557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17951): Launched 11:48:14.705470 run iperf3-srv_10.42.42.10(pid=17952): Launched 11:48:14.829778 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:48:15.053997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:15.388099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17953): Launched 11:48:15.677756 run iperf3-srv_10.42.42.10(pid=17954): Launched 11:48:15.802183 tst cs_paging_gprs_active.py:38: start network... 11:48:16.049676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:16.548678 run create_hlr_db(pid=17955): Launched 11:48:16.705189 bus /sierra_2: Setting Powered False 11:48:17.770313 run create_hlr_db(pid=17955): Terminated: ok {rc=0} 11:48:18.213411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17957): Launched 11:48:18.522809 run osmo-hlr_10.42.42.2(pid=17958): Launched 11:48:18.643646 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:19.188418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17960): Launched 11:48:19.499776 run osmo-stp_10.42.42.5(pid=17961): Launched 11:48:19.619314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:20.154769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17963): Launched 11:48:20.275732 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:20.538594 run patchelf(pid=17964): Launched 11:48:20.713646 run osmo-stp_10.42.42.5(pid=17961): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17961)] 11:48:20.845295 run osmo-stp_10.42.42.5(pid=17961): stdout: | (launched: 2022-12-14_11:48:19.442310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:20.979022 run osmo-stp_10.42.42.5(pid=17961): stderr: | [0;m[38;5;43m20221214114819610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114819610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114819610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114819611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114819611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114819611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114819611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:21.112829 run osmo-stp_10.42.42.5(pid=17961): stdout: | (launched: 2022-12-14_11:48:19.442310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:21.239993 run osmo-stp_10.42.42.5(pid=17961): stderr: | [0;m[38;5;43m20221214114819610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114819610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114819610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114819611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114819611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114819611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114819611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:21.390709 run patchelf(pid=17964): Terminating (SIGINT) 11:48:21.564590 run patchelf(pid=17964): Terminated: ok {rc=0} 11:48:21.690370 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17961): Process ended prematurely: osmo-stp_10.42.42.5(pid=17961) [trial-2404↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17961)] [trial-2404↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 11:48:21.699965 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:48:21.727244 run osmo-hlr_10.42.42.2(pid=17958): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17958)] 11:48:21.776100 run osmo-hlr_10.42.42.2(pid=17958): stdout: | (launched: 2022-12-14_11:48:18.465246) 11:48:21.826363 run osmo-hlr_10.42.42.2(pid=17958): stderr: | [0;m[1;31m20221214114818640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114818640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114818640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114818640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114818640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114818641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114818652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114818660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114818660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114818660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:21.876740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17951): Terminating (SIGTERM) 11:48:21.917036 run iperf3-srv_10.42.42.10(pid=17952): Terminating (SIGTERM) 11:48:21.958925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17953): Terminating (SIGTERM) 11:48:21.999871 run iperf3-srv_10.42.42.10(pid=17954): Terminating (SIGTERM) 11:48:22.040799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17957): Terminating (SIGTERM) 11:48:22.081460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17960): Terminating (SIGTERM) 11:48:22.122384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17963): Terminating (SIGTERM) 11:48:22.163497 --- ParallelTerminationStrategy: PID 17951 died... 11:48:22.182906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17951): Terminated: ok {rc=0} 11:48:22.227345 --- ParallelTerminationStrategy: PID 17952 died... 11:48:22.246316 run iperf3-srv_10.42.42.10(pid=17952): Terminated {rc=256} 11:48:22.290209 --- ParallelTerminationStrategy: PID 17953 died... 11:48:22.309038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17953): Terminated: ok {rc=0} 11:48:22.352758 --- ParallelTerminationStrategy: PID 17954 died... 11:48:22.371660 run iperf3-srv_10.42.42.10(pid=17954): Terminated {rc=256} 11:48:22.415676 --- ParallelTerminationStrategy: PID 17957 died... 11:48:22.434593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17957): Terminated: ok {rc=0} 11:48:22.478491 --- ParallelTerminationStrategy: PID 17960 died... 11:48:22.497401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17960): Terminated: ok {rc=0} 11:48:22.541324 --- ParallelTerminationStrategy: PID 17963 died... 11:48:22.560430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17963): Terminated: ok {rc=0} 11:48:22.645680 bus /gobi_0: Setting Powered False 11:48:23.745233 bus /gobi_0: Setting Powered False 11:48:24.863503 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200 iperf3.py ---------------------------------------------- 11:48:26.011970 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:26.023261 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:48:26.074851 tst iperf3.py: using LAC 40688 11:48:26.197504 tst iperf3.py: using RAC 143 11:48:26.318747 tst iperf3.py: using CellId 40688 11:48:26.445781 tst iperf3.py: using BVCI 40689 11:48:26.560342 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:26.571137 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:26.581683 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:26.592002 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:26.602634 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:26.613291 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:26.624091 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:26.634728 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:26.645566 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:48:26.762648 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:48:26.970218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:27.281774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17965): Launched 11:48:27.552559 run iperf3-srv_10.42.42.10(pid=17966): Launched 11:48:27.669216 tst iperf3.py:8: start network... 11:48:27.875419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:28.352130 run create_hlr_db(pid=17967): Launched 11:48:28.468885 bus /gobi_6: Setting Powered False 11:48:29.534153 run create_hlr_db(pid=17967): Terminated: ok {rc=0} 11:48:29.975061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17969): Launched 11:48:30.286422 run osmo-hlr_10.42.42.2(pid=17970): Launched 11:48:30.403755 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:30.961640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17972): Launched 11:48:31.289615 run osmo-stp_10.42.42.5(pid=17973): Launched 11:48:31.564010 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:32.205686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17975): Launched 11:48:32.340459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:32.621570 run patchelf(pid=17976): Launched 11:48:32.807547 run osmo-stp_10.42.42.5(pid=17973): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17973)] 11:48:32.947353 run osmo-stp_10.42.42.5(pid=17973): stdout: | (launched: 2022-12-14_11:48:31.231132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:33.089823 run osmo-stp_10.42.42.5(pid=17973): stderr: | [0;m[38;5;43m20221214114831483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114831483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114831483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114831484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114831484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114831484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114831484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:33.231185 run osmo-stp_10.42.42.5(pid=17973): stdout: | (launched: 2022-12-14_11:48:31.231132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:33.366677 run osmo-stp_10.42.42.5(pid=17973): stderr: | [0;m[38;5;43m20221214114831483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114831483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114831483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114831484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114831484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114831484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114831484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:33.526730 run patchelf(pid=17976): Terminating (SIGINT) 11:48:33.712243 run patchelf(pid=17976): Terminated: ok {rc=0} 11:48:33.845781 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17973): Process ended prematurely: osmo-stp_10.42.42.5(pid=17973) [trial-2404↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17973)] [trial-2404↪gprs:trx-b200↪iperf3.py:8] 11:48:33.856192 tst iperf3.py:8: Test FAILED (7.9 sec) 11:48:33.884723 run osmo-hlr_10.42.42.2(pid=17970): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17970)] 11:48:33.934674 run osmo-hlr_10.42.42.2(pid=17970): stdout: | (launched: 2022-12-14_11:48:30.228812) 11:48:33.986268 run osmo-hlr_10.42.42.2(pid=17970): stderr: | [0;m[1;31m20221214114830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114830416 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114830424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114830425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114830425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:34.038498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17965): Terminating (SIGTERM) 11:48:34.080809 run iperf3-srv_10.42.42.10(pid=17966): Terminating (SIGTERM) 11:48:34.122950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17969): Terminating (SIGTERM) 11:48:34.165309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17972): Terminating (SIGTERM) 11:48:34.207263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17975): Terminating (SIGTERM) 11:48:34.250079 --- ParallelTerminationStrategy: PID 17965 died... 11:48:34.270163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17965): Terminated: ok {rc=0} 11:48:34.316518 --- ParallelTerminationStrategy: PID 17966 died... 11:48:34.336147 run iperf3-srv_10.42.42.10(pid=17966): Terminated {rc=256} 11:48:34.382053 --- ParallelTerminationStrategy: PID 17969 died... 11:48:34.401494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17969): Terminated: ok {rc=0} 11:48:34.447433 --- ParallelTerminationStrategy: PID 17972 died... 11:48:34.466971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17972): Terminated: ok {rc=0} 11:48:34.512589 --- ParallelTerminationStrategy: PID 17975 died... 11:48:34.532081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17975): Terminated: ok {rc=0} 11:48:34.619788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 11:48:35.770874 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:35.782715 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:48:35.832423 tst iperf3m4.py: using LAC 40689 11:48:35.962809 tst iperf3m4.py: using RAC 144 11:48:36.093245 tst iperf3m4.py: using CellId 40689 11:48:36.225181 tst iperf3m4.py: using BVCI 40690 11:48:36.346653 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:36.357867 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:36.368722 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:36.379637 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:36.390519 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:36.401413 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:36.412409 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:36.423352 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:36.434374 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:48:36.555282 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:48:36.679990 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:48:36.803633 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:48:36.925881 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:48:37.150494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:37.483432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17977): Launched 11:48:37.775350 run iperf3-srv_10.42.42.10(pid=17978): Launched 11:48:37.901692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:48:38.124725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:38.457299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17979): Launched 11:48:38.747320 run iperf3-srv_10.42.42.10(pid=17980): Launched 11:48:38.873957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:48:39.097630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:39.431685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17981): Launched 11:48:39.722259 run iperf3-srv_10.42.42.10(pid=17982): Launched 11:48:39.846106 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:48:40.069073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:48:40.402340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17983): Launched 11:48:40.692476 run iperf3-srv_10.42.42.10(pid=17984): Launched 11:48:40.818038 tst iperf3m4.py:8: start network... 11:48:41.041135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:41.555474 run create_hlr_db(pid=17985): Launched 11:48:41.691409 bus /gobi_6: Setting Powered False 11:48:42.756437 run create_hlr_db(pid=17985): Terminated: ok {rc=0} 11:48:43.219093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17987): Launched 11:48:43.552268 run osmo-hlr_10.42.42.2(pid=17988): Launched 11:48:43.678975 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:44.251343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17990): Launched 11:48:44.584470 run osmo-stp_10.42.42.5(pid=17991): Launched 11:48:44.711579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:48:45.283922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17993): Launched 11:48:45.412377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:48:45.694183 run patchelf(pid=17994): Launched 11:48:45.879559 run osmo-stp_10.42.42.5(pid=17991): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17991)] 11:48:46.028260 run osmo-stp_10.42.42.5(pid=17991): stdout: | (launched: 2022-12-14_11:48:44.523112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:46.177139 run osmo-stp_10.42.42.5(pid=17991): stderr: | [0;m[38;5;43m20221214114844713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114844713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114844714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114844714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114844714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114844715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114844715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:46.322958 run osmo-stp_10.42.42.5(pid=17991): stdout: | (launched: 2022-12-14_11:48:44.523112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:46.463666 run osmo-stp_10.42.42.5(pid=17991): stderr: | [0;m[38;5;43m20221214114844713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114844713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114844714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114844714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114844714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114844715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114844715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:46.629224 run patchelf(pid=17994): Terminating (SIGINT) 11:48:46.819616 run patchelf(pid=17994): Terminated: ok {rc=0} 11:48:46.957170 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17991): Process ended prematurely: osmo-stp_10.42.42.5(pid=17991) [trial-2404↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17991)] [trial-2404↪gprs:trx-b200↪iperf3m4.py:8] 11:48:46.968647 tst iperf3m4.py:8: Test FAILED (11.2 sec) 11:48:46.999595 run osmo-hlr_10.42.42.2(pid=17988): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17988)] 11:48:47.052330 run osmo-hlr_10.42.42.2(pid=17988): stdout: | (launched: 2022-12-14_11:48:43.491052) 11:48:47.106313 run osmo-hlr_10.42.42.2(pid=17988): stderr: | [0;m[1;31m20221214114843690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114843690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114843690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114843690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114843690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114843690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114843702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114843711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114843711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114843711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:47.160289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17977): Terminating (SIGTERM) 11:48:47.203910 run iperf3-srv_10.42.42.10(pid=17978): Terminating (SIGTERM) 11:48:47.245965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17979): Terminating (SIGTERM) 11:48:47.287854 run iperf3-srv_10.42.42.10(pid=17980): Terminating (SIGTERM) 11:48:47.329810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17981): Terminating (SIGTERM) 11:48:47.371766 run iperf3-srv_10.42.42.10(pid=17982): Terminating (SIGTERM) 11:48:47.413626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17983): Terminating (SIGTERM) 11:48:47.455423 run iperf3-srv_10.42.42.10(pid=17984): Terminating (SIGTERM) 11:48:47.497710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17987): Terminating (SIGTERM) 11:48:47.539650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17990): Terminating (SIGTERM) 11:48:47.582027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17993): Terminating (SIGTERM) 11:48:47.624187 --- ParallelTerminationStrategy: PID 17977 died... 11:48:47.644257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17977): Terminated: ok {rc=0} 11:48:47.690662 --- ParallelTerminationStrategy: PID 17978 died... 11:48:47.710199 run iperf3-srv_10.42.42.10(pid=17978): Terminated {rc=256} 11:48:47.756253 --- ParallelTerminationStrategy: PID 17979 died... 11:48:47.775961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17979): Terminated: ok {rc=0} 11:48:47.822654 --- ParallelTerminationStrategy: PID 17980 died... 11:48:47.842229 run iperf3-srv_10.42.42.10(pid=17980): Terminated {rc=256} 11:48:47.888380 --- ParallelTerminationStrategy: PID 17981 died... 11:48:47.908122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17981): Terminated: ok {rc=0} 11:48:47.954431 --- ParallelTerminationStrategy: PID 17982 died... 11:48:47.974110 run iperf3-srv_10.42.42.10(pid=17982): Terminated {rc=256} 11:48:48.020079 --- ParallelTerminationStrategy: PID 17983 died... 11:48:48.039712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17983): Terminated: ok {rc=0} 11:48:48.086330 --- ParallelTerminationStrategy: PID 17984 died... 11:48:48.106030 run iperf3-srv_10.42.42.10(pid=17984): Terminated {rc=256} 11:48:48.152101 --- ParallelTerminationStrategy: PID 17987 died... 11:48:48.171852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17987): Terminated: ok {rc=0} 11:48:48.217962 --- ParallelTerminationStrategy: PID 17990 died... 11:48:48.237743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17990): Terminated: ok {rc=0} 11:48:48.283812 --- ParallelTerminationStrategy: PID 17993 died... 11:48:48.303525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17993): Terminated: ok {rc=0} 11:48:48.391884 bus /gobi_4: Setting Powered False 11:48:49.491693 bus /gobi_4: Setting Powered False 11:48:50.609567 bus /gobi_1: Setting Powered False 11:48:51.709428 bus /gobi_1: Setting Powered False 11:48:52.825886 bus /gobi_0: Setting Powered False 11:48:53.926709 bus /gobi_0: Setting Powered False 11:48:55.043567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200 ping.py ---------------------------------------------- 11:48:56.146522 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:56.158834 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:48:56.209537 tst ping.py: using LAC 40690 11:48:56.332018 tst ping.py: using RAC 145 11:48:56.455365 tst ping.py: using CellId 40690 11:48:56.572865 tst ping.py: using BVCI 40691 11:48:56.682659 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:56.693386 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:56.703935 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:56.714467 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:56.725191 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:56.735986 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:56.746895 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:48:56.757701 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:48:56.878200 tst ping.py:19: start network... 11:48:57.082882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:57.551915 run create_hlr_db(pid=17995): Launched 11:48:57.666892 bus /gobi_6: Setting Powered False 11:48:58.727249 run create_hlr_db(pid=17995): Terminated: ok {rc=0} 11:48:59.150852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17997): Launched 11:48:59.456777 run osmo-hlr_10.42.42.2(pid=17998): Launched 11:48:59.572796 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:00.110172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18000): Launched 11:49:00.416014 run osmo-stp_10.42.42.5(pid=18001): Launched 11:49:00.533125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:01.099721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18003): Launched 11:49:01.238554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:01.524549 run patchelf(pid=18004): Launched 11:49:01.728007 run osmo-stp_10.42.42.5(pid=18001): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18001)] 11:49:01.869865 run osmo-stp_10.42.42.5(pid=18001): stdout: | (launched: 2022-12-14_11:49:00.359274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:02.013748 run osmo-stp_10.42.42.5(pid=18001): stderr: | [0;m[38;5;43m20221214114900528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114900528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114900529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114900529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114900530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114900530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114900530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:02.156474 run osmo-stp_10.42.42.5(pid=18001): stdout: | (launched: 2022-12-14_11:49:00.359274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:02.291403 run osmo-stp_10.42.42.5(pid=18001): stderr: | [0;m[38;5;43m20221214114900528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114900528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114900529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114900529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114900530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114900530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114900530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:02.450101 run patchelf(pid=18004): Terminating (SIGINT) 11:49:02.633334 run patchelf(pid=18004): Terminated: ok {rc=0} 11:49:02.765162 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18001): Process ended prematurely: osmo-stp_10.42.42.5(pid=18001) [trial-2404↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18001)] [trial-2404↪gprs:trx-b200↪ping.py:22] 11:49:02.774847 tst ping.py:22: Test FAILED (6.6 sec) 11:49:02.803396 run osmo-hlr_10.42.42.2(pid=17998): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17998)] 11:49:02.854800 run osmo-hlr_10.42.42.2(pid=17998): stdout: | (launched: 2022-12-14_11:48:59.399962) 11:49:02.907542 run osmo-hlr_10.42.42.2(pid=17998): stderr: | [0;m[1;31m20221214114859574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114859574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114859574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114859574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114859574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114859574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114859586 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114859594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114859594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114859594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:02.960593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17997): Terminating (SIGTERM) 11:49:03.003493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18000): Terminating (SIGTERM) 11:49:03.046414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18003): Terminating (SIGTERM) 11:49:03.089850 --- ParallelTerminationStrategy: PID 17997 died... 11:49:03.110390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17997): Terminated: ok {rc=0} 11:49:03.157789 --- ParallelTerminationStrategy: PID 18000 died... 11:49:03.178006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18000): Terminated: ok {rc=0} 11:49:03.225129 --- ParallelTerminationStrategy: PID 18003 died... 11:49:03.245193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18003): Terminated: ok {rc=0} 11:49:03.334482 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 11:49:04.423145 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:49:04.435253 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:49:04.485533 tst ping_idle_ping.py: using LAC 40691 11:49:04.616702 tst ping_idle_ping.py: using RAC 146 11:49:04.743063 tst ping_idle_ping.py: using CellId 40691 11:49:04.869077 tst ping_idle_ping.py: using BVCI 40692 11:49:04.987162 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:49:04.998283 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:49:05.009396 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:49:05.020253 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:49:05.031182 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:49:05.042176 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:49:05.053288 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:49:05.064569 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:49:05.181409 tst ping_idle_ping.py:24: start network... 11:49:05.386951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:05.871565 run create_hlr_db(pid=18005): Launched 11:49:05.985467 bus /gobi_6: Setting Powered False 11:49:07.045182 run create_hlr_db(pid=18005): Terminated: ok {rc=0} 11:49:07.484283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18007): Launched 11:49:07.803123 run osmo-hlr_10.42.42.2(pid=18008): Launched 11:49:07.922770 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:08.470360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18010): Launched 11:49:08.787778 run osmo-stp_10.42.42.5(pid=18011): Launched 11:49:08.908437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:09.457768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18013): Launched 11:49:09.579387 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:09.848494 run patchelf(pid=18014): Launched 11:49:10.025075 run osmo-stp_10.42.42.5(pid=18011): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18011)] 11:49:10.160213 run osmo-stp_10.42.42.5(pid=18011): stdout: | (launched: 2022-12-14_11:49:08.729022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:10.296637 run osmo-stp_10.42.42.5(pid=18011): stderr: | [0;m[38;5;43m20221214114908915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114908916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114908916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114908916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114908917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114908917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114908917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:10.433364 run osmo-stp_10.42.42.5(pid=18011): stdout: | (launched: 2022-12-14_11:49:08.729022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:10.563201 run osmo-stp_10.42.42.5(pid=18011): stderr: | [0;m[38;5;43m20221214114908915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114908916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114908916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114908916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114908917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114908917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114908917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:10.717119 run patchelf(pid=18014): Terminating (SIGINT) 11:49:10.895431 run patchelf(pid=18014): Terminated: ok {rc=0} 11:49:11.023908 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18011): Process ended prematurely: osmo-stp_10.42.42.5(pid=18011) [trial-2404↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18011)] [trial-2404↪gprs:trx-b200↪ping_idle_ping.py:27] 11:49:11.033595 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 11:49:11.061951 run osmo-hlr_10.42.42.2(pid=18008): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18008)] 11:49:11.112289 run osmo-hlr_10.42.42.2(pid=18008): stdout: | (launched: 2022-12-14_11:49:07.744563) 11:49:11.164081 run osmo-hlr_10.42.42.2(pid=18008): stderr: | [0;m[1;31m20221214114907938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114907938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114907938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114907938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114907938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114907938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114907950 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114907958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114907958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114907958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:11.216272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18007): Terminating (SIGTERM) 11:49:11.258368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18010): Terminating (SIGTERM) 11:49:11.300805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18013): Terminating (SIGTERM) 11:49:11.343165 --- ParallelTerminationStrategy: PID 18007 died... 11:49:11.363371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18007): Terminated: ok {rc=0} 11:49:11.410152 --- ParallelTerminationStrategy: PID 18010 died... 11:49:11.429756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18010): Terminated: ok {rc=0} 11:49:11.475779 --- ParallelTerminationStrategy: PID 18013 died... 11:49:11.495415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18013): Terminated: ok {rc=0} 11:49:11.583938 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 11:49:12.890120 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:49:12.896018 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:49:12.929137 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:49:12.968032 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:49:13.056885 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:49:13.090528 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:49:13.129124 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:49:13.722881 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:49:13.774715 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:13.785784 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:49:13.836095 tst cs_paging_gprs_active.py: using LAC 40692 11:49:13.968374 tst cs_paging_gprs_active.py: using RAC 147 11:49:14.094442 tst cs_paging_gprs_active.py: using CellId 40692 11:49:14.221946 tst cs_paging_gprs_active.py: using BVCI 40693 11:49:14.340622 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:14.351868 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:14.362787 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:14.373765 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:14.384613 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:14.395563 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:14.406709 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:14.417563 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:14.428592 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:49:14.545110 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:49:14.667433 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:49:14.886229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:15.211646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18019): Launched 11:49:15.495878 run iperf3-srv_10.42.42.10(pid=18020): Launched 11:49:15.616862 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:49:15.834338 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:16.165132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18021): Launched 11:49:16.473693 run iperf3-srv_10.42.42.10(pid=18022): Launched 11:49:16.600340 tst cs_paging_gprs_active.py:38: start network... 11:49:16.823261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:17.351219 run create_hlr_db(pid=18023): Launched 11:49:17.483464 bus /gobi_6: Setting Powered False 11:49:18.548002 run create_hlr_db(pid=18023): Terminated: ok {rc=0} 11:49:18.982333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18025): Launched 11:49:19.287061 run osmo-hlr_10.42.42.2(pid=18026): Launched 11:49:19.402613 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:19.936157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18028): Launched 11:49:20.241102 run osmo-stp_10.42.42.5(pid=18029): Launched 11:49:20.357309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:20.879386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18031): Launched 11:49:20.995601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:21.252416 run patchelf(pid=18032): Launched 11:49:21.423442 run osmo-stp_10.42.42.5(pid=18029): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18029)] 11:49:21.554035 run osmo-stp_10.42.42.5(pid=18029): stdout: | (launched: 2022-12-14_11:49:20.184570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:21.685516 run osmo-stp_10.42.42.5(pid=18029): stderr: | [0;m[38;5;43m20221214114920351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114920352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114920352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114920352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114920353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114920353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114920353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:21.817110 run osmo-stp_10.42.42.5(pid=18029): stdout: | (launched: 2022-12-14_11:49:20.184570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:21.942463 run osmo-stp_10.42.42.5(pid=18029): stderr: | [0;m[38;5;43m20221214114920351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114920352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114920352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114920352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114920353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114920353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114920353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:22.091619 run patchelf(pid=18032): Terminating (SIGINT) 11:49:22.263768 run patchelf(pid=18032): Terminated: ok {rc=0} 11:49:22.388209 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18029): Process ended prematurely: osmo-stp_10.42.42.5(pid=18029) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18029)] [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:49:22.397756 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:49:22.424516 run osmo-hlr_10.42.42.2(pid=18026): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18026)] 11:49:22.472585 run osmo-hlr_10.42.42.2(pid=18026): stdout: | (launched: 2022-12-14_11:49:19.230849) 11:49:22.521951 run osmo-hlr_10.42.42.2(pid=18026): stderr: | [0;m[1;31m20221214114919403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114919403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114919404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114919404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114919404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114919404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114919416 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114919427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114919427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114919427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:22.571808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18019): Terminating (SIGTERM) 11:49:22.611932 run iperf3-srv_10.42.42.10(pid=18020): Terminating (SIGTERM) 11:49:22.651902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18021): Terminating (SIGTERM) 11:49:22.691835 run iperf3-srv_10.42.42.10(pid=18022): Terminating (SIGTERM) 11:49:22.731304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18025): Terminating (SIGTERM) 11:49:22.771145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18028): Terminating (SIGTERM) 11:49:22.810913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18031): Terminating (SIGTERM) 11:49:22.850839 --- ParallelTerminationStrategy: PID 18019 died... 11:49:22.870205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18019): Terminated: ok {rc=0} 11:49:22.914232 --- ParallelTerminationStrategy: PID 18020 died... 11:49:22.932857 run iperf3-srv_10.42.42.10(pid=18020): Terminated {rc=256} 11:49:22.976517 --- ParallelTerminationStrategy: PID 18021 died... 11:49:22.995257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18021): Terminated: ok {rc=0} 11:49:23.038984 --- ParallelTerminationStrategy: PID 18022 died... 11:49:23.057634 run iperf3-srv_10.42.42.10(pid=18022): Terminated {rc=256} 11:49:23.101219 --- ParallelTerminationStrategy: PID 18025 died... 11:49:23.120046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18025): Terminated: ok {rc=0} 11:49:23.163922 --- ParallelTerminationStrategy: PID 18028 died... 11:49:23.182612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18028): Terminated: ok {rc=0} 11:49:23.226138 --- ParallelTerminationStrategy: PID 18031 died... 11:49:23.244824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18031): Terminated: ok {rc=0} 11:49:23.329857 bus /gobi_0: Setting Powered False 11:49:24.428616 bus /gobi_0: Setting Powered False 11:49:25.543852 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:49:26.692047 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:26.703979 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:49:26.757856 tst iperf3.py: using LAC 40693 11:49:26.888604 tst iperf3.py: using RAC 148 11:49:27.016703 tst iperf3.py: using CellId 40693 11:49:27.145490 tst iperf3.py: using BVCI 40694 11:49:27.265809 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:27.277196 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:27.288187 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:27.299185 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:27.310356 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:27.321349 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:27.332518 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:27.343511 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:27.354798 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:49:27.474877 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:49:27.696858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:28.026281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18033): Launched 11:49:28.311868 run iperf3-srv_10.42.42.10(pid=18034): Launched 11:49:28.435342 tst iperf3.py:8: start network... 11:49:28.655024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:29.161414 run create_hlr_db(pid=18035): Launched 11:49:29.294017 bus /gobi_6: Setting Powered False 11:49:30.358234 run create_hlr_db(pid=18035): Terminated: ok {rc=0} 11:49:30.793328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18037): Launched 11:49:31.169675 run osmo-hlr_10.42.42.2(pid=18038): Launched 11:49:31.415757 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:32.068308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18040): Launched 11:49:32.405822 run osmo-stp_10.42.42.5(pid=18041): Launched 11:49:32.531459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:33.095454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18043): Launched 11:49:33.221593 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:33.498029 run patchelf(pid=18044): Launched 11:49:33.680324 run osmo-stp_10.42.42.5(pid=18041): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18041)] 11:49:33.818634 run osmo-stp_10.42.42.5(pid=18041): stdout: | (launched: 2022-12-14_11:49:32.345527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:33.958641 run osmo-stp_10.42.42.5(pid=18041): stderr: | [0;m[38;5;43m20221214114932535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114932535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114932536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114932536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114932536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114932537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114932537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:34.099412 run osmo-stp_10.42.42.5(pid=18041): stdout: | (launched: 2022-12-14_11:49:32.345527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:34.233179 run osmo-stp_10.42.42.5(pid=18041): stderr: | [0;m[38;5;43m20221214114932535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114932535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114932536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114932536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114932536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114932537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114932537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:34.391848 run patchelf(pid=18044): Terminating (SIGINT) 11:49:34.574978 run patchelf(pid=18044): Terminated: ok {rc=0} 11:49:34.706830 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18041): Process ended prematurely: osmo-stp_10.42.42.5(pid=18041) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18041)] [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 11:49:34.716910 tst iperf3.py:8: Test FAILED (8.1 sec) 11:49:34.745316 run osmo-hlr_10.42.42.2(pid=18038): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18038)] 11:49:34.795282 run osmo-hlr_10.42.42.2(pid=18038): stdout: | (launched: 2022-12-14_11:49:31.103012) 11:49:34.846996 run osmo-hlr_10.42.42.2(pid=18038): stderr: | [0;m[1;31m20221214114931343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114931343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114931343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114931343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114931343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114931343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114931392 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114931400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114931400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114931400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:34.899128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18033): Terminating (SIGTERM) 11:49:34.940832 run iperf3-srv_10.42.42.10(pid=18034): Terminating (SIGTERM) 11:49:34.982928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18037): Terminating (SIGTERM) 11:49:35.024540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18040): Terminating (SIGTERM) 11:49:35.066665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18043): Terminating (SIGTERM) 11:49:35.108820 --- ParallelTerminationStrategy: PID 18033 died... 11:49:35.128793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18033): Terminated: ok {rc=0} 11:49:35.175012 --- ParallelTerminationStrategy: PID 18034 died... 11:49:35.194357 run iperf3-srv_10.42.42.10(pid=18034): Terminated {rc=256} 11:49:35.240057 --- ParallelTerminationStrategy: PID 18037 died... 11:49:35.259506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18037): Terminated: ok {rc=0} 11:49:35.305310 --- ParallelTerminationStrategy: PID 18040 died... 11:49:35.324692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18040): Terminated: ok {rc=0} 11:49:35.370474 --- ParallelTerminationStrategy: PID 18043 died... 11:49:35.389914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18043): Terminated: ok {rc=0} 11:49:35.478064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:49:36.628145 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:36.640150 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:49:36.692666 tst iperf3m4.py: using LAC 40694 11:49:36.821061 tst iperf3m4.py: using RAC 149 11:49:36.949326 tst iperf3m4.py: using CellId 40694 11:49:37.079444 tst iperf3m4.py: using BVCI 40695 11:49:37.197727 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:37.209273 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:37.220446 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:37.231681 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:37.242777 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:37.253962 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:37.265300 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:37.276328 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:37.287594 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:49:37.404551 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:49:37.523084 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:49:37.643599 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:49:37.760676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:49:37.963804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:38.267989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18045): Launched 11:49:38.532775 run iperf3-srv_10.42.42.10(pid=18046): Launched 11:49:38.646504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:49:38.847787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:39.151250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18047): Launched 11:49:39.416327 run iperf3-srv_10.42.42.10(pid=18048): Launched 11:49:39.529964 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:49:39.732348 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:40.036520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18049): Launched 11:49:40.301542 run iperf3-srv_10.42.42.10(pid=18050): Launched 11:49:40.415922 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:49:40.618258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:40.922265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18051): Launched 11:49:41.188482 run iperf3-srv_10.42.42.10(pid=18052): Launched 11:49:41.302781 tst iperf3m4.py:8: start network... 11:49:41.506769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:41.979040 run create_hlr_db(pid=18053): Launched 11:49:42.097139 bus /gobi_6: Setting Powered False 11:49:43.158587 run create_hlr_db(pid=18053): Terminated: ok {rc=0} 11:49:43.584362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18055): Launched 11:49:43.890891 run osmo-hlr_10.42.42.2(pid=18056): Launched 11:49:44.006758 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:44.546119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18058): Launched 11:49:44.853721 run osmo-stp_10.42.42.5(pid=18059): Launched 11:49:44.969621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:45.496463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18061): Launched 11:49:45.623297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:45.921790 run patchelf(pid=18062): Launched 11:49:46.120669 run osmo-stp_10.42.42.5(pid=18059): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18059)] 11:49:46.262288 run osmo-stp_10.42.42.5(pid=18059): stdout: | (launched: 2022-12-14_11:49:44.797236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:46.405621 run osmo-stp_10.42.42.5(pid=18059): stderr: | [0;m[38;5;43m20221214114944966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114944967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114944968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114944968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114944969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114944969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114944969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:46.546509 run osmo-stp_10.42.42.5(pid=18059): stdout: | (launched: 2022-12-14_11:49:44.797236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:46.680181 run osmo-stp_10.42.42.5(pid=18059): stderr: | [0;m[38;5;43m20221214114944966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214114944967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214114944968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214114944968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214114944969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214114944969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214114944969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:46.835249 run patchelf(pid=18062): Terminating (SIGINT) 11:49:47.014203 run patchelf(pid=18062): Terminated: ok {rc=0} 11:49:47.141784 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18059): Process ended prematurely: osmo-stp_10.42.42.5(pid=18059) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18059)] [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 11:49:47.152371 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:49:47.182208 run osmo-hlr_10.42.42.2(pid=18056): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18056)] 11:49:47.234838 run osmo-hlr_10.42.42.2(pid=18056): stdout: | (launched: 2022-12-14_11:49:43.834407) 11:49:47.286667 run osmo-hlr_10.42.42.2(pid=18056): stderr: | [0;m[1;31m20221214114944009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114944009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114944009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114944010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114944010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114944010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114944023 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114944032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114944032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114944032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:47.341131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18045): Terminating (SIGTERM) 11:49:47.384905 run iperf3-srv_10.42.42.10(pid=18046): Terminating (SIGTERM) 11:49:47.426446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18047): Terminating (SIGTERM) 11:49:47.466664 run iperf3-srv_10.42.42.10(pid=18048): Terminating (SIGTERM) 11:49:47.507113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18049): Terminating (SIGTERM) 11:49:47.547549 run iperf3-srv_10.42.42.10(pid=18050): Terminating (SIGTERM) 11:49:47.587456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18051): Terminating (SIGTERM) 11:49:47.627431 run iperf3-srv_10.42.42.10(pid=18052): Terminating (SIGTERM) 11:49:47.667920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18055): Terminating (SIGTERM) 11:49:47.708268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18058): Terminating (SIGTERM) 11:49:47.748534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18061): Terminating (SIGTERM) 11:49:47.788425 --- ParallelTerminationStrategy: PID 18045 died... 11:49:47.807336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18045): Terminated: ok {rc=0} 11:49:47.851474 --- ParallelTerminationStrategy: PID 18046 died... 11:49:47.870464 run iperf3-srv_10.42.42.10(pid=18046): Terminated {rc=256} 11:49:47.914529 --- ParallelTerminationStrategy: PID 18047 died... 11:49:47.933407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18047): Terminated: ok {rc=0} 11:49:47.977229 --- ParallelTerminationStrategy: PID 18048 died... 11:49:47.996153 run iperf3-srv_10.42.42.10(pid=18048): Terminated {rc=256} 11:49:48.039925 --- ParallelTerminationStrategy: PID 18049 died... 11:49:48.058742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18049): Terminated: ok {rc=0} 11:49:48.102853 --- ParallelTerminationStrategy: PID 18050 died... 11:49:48.121770 run iperf3-srv_10.42.42.10(pid=18050): Terminated {rc=256} 11:49:48.165697 --- ParallelTerminationStrategy: PID 18051 died... 11:49:48.184552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18051): Terminated: ok {rc=0} 11:49:48.228501 --- ParallelTerminationStrategy: PID 18052 died... 11:49:48.247537 run iperf3-srv_10.42.42.10(pid=18052): Terminated {rc=256} 11:49:48.291445 --- ParallelTerminationStrategy: PID 18055 died... 11:49:48.310406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18055): Terminated: ok {rc=0} 11:49:48.354600 --- ParallelTerminationStrategy: PID 18058 died... 11:49:48.373599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18058): Terminated: ok {rc=0} 11:49:48.417682 --- ParallelTerminationStrategy: PID 18061 died... 11:49:48.436675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18061): Terminated: ok {rc=0} 11:49:48.523533 bus /gobi_4: Setting Powered False 11:49:49.623840 bus /gobi_4: Setting Powered False 11:49:50.741121 bus /gobi_1: Setting Powered False 11:49:51.840308 bus /gobi_1: Setting Powered False 11:49:52.956716 bus /gobi_0: Setting Powered False 11:49:54.055837 bus /gobi_0: Setting Powered False 11:49:55.173385 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 11:49:56.276624 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:56.288603 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:49:56.338620 tst ping.py: using LAC 40695 11:49:56.463476 tst ping.py: using RAC 150 11:49:56.589879 tst ping.py: using CellId 40695 11:49:56.709187 tst ping.py: using BVCI 40696 11:49:56.819260 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:56.830148 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:56.840735 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:56.851483 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:56.862396 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:56.873289 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:56.884303 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:49:56.895600 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:49:57.014541 tst ping.py:19: start network... 11:49:57.231145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:57.727245 run create_hlr_db(pid=18063): Launched 11:49:57.859055 bus /gobi_6: Setting Powered False 11:49:58.922310 run create_hlr_db(pid=18063): Terminated: ok {rc=0} 11:49:59.353740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18065): Launched 11:49:59.654671 run osmo-hlr_10.42.42.2(pid=18066): Launched 11:49:59.770570 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:00.303179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18068): Launched 11:50:00.602922 run osmo-stp_10.42.42.5(pid=18069): Launched 11:50:00.717949 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:01.276630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18074): Launched 11:50:01.426818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:01.692283 run patchelf(pid=18078): Launched 11:50:01.877913 run osmo-stp_10.42.42.5(pid=18069): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18069)] 11:50:02.009243 run osmo-stp_10.42.42.5(pid=18069): stdout: | (launched: 2022-12-14_11:50:00.547369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:02.146713 run osmo-stp_10.42.42.5(pid=18069): stderr: | [0;m[38;5;43m20221214115000712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115000712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115000712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115000713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115000713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115000713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115000713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:02.309123 run osmo-stp_10.42.42.5(pid=18069): stdout: | (launched: 2022-12-14_11:50:00.547369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:02.435813 run osmo-stp_10.42.42.5(pid=18069): stderr: | [0;m[38;5;43m20221214115000712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115000712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115000712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115000713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115000713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115000713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115000713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:02.581960 run patchelf(pid=18078): Terminating (SIGINT) 11:50:02.750576 run patchelf(pid=18078): Terminated: ok {rc=0} 11:50:02.872344 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18069): Process ended prematurely: osmo-stp_10.42.42.5(pid=18069) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18069)] [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 11:50:02.881520 tst ping.py:22: Test FAILED (6.6 sec) 11:50:02.908466 run osmo-hlr_10.42.42.2(pid=18066): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18066)] 11:50:02.957209 run osmo-hlr_10.42.42.2(pid=18066): stdout: | (launched: 2022-12-14_11:49:59.598801) 11:50:03.007133 run osmo-hlr_10.42.42.2(pid=18066): stderr: | [0;m[1;31m20221214114959771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214114959771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214114959771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214114959771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214114959771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214114959771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214114959783 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214114959794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214114959794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214114959794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:03.057568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18065): Terminating (SIGTERM) 11:50:03.098009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18068): Terminating (SIGTERM) 11:50:03.138311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18074): Terminating (SIGTERM) 11:50:03.179172 --- ParallelTerminationStrategy: PID 18065 died... 11:50:03.198811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18065): Terminated: ok {rc=0} 11:50:03.243487 --- ParallelTerminationStrategy: PID 18068 died... 11:50:03.262550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18068): Terminated: ok {rc=0} 11:50:03.306834 --- ParallelTerminationStrategy: PID 18074 died... 11:50:03.326009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18074): Terminated: ok {rc=0} 11:50:03.412916 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:50:04.503605 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:04.516173 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:50:04.571586 tst ping_idle_ping.py: using LAC 40696 11:50:04.699516 tst ping_idle_ping.py: using RAC 151 11:50:04.825771 tst ping_idle_ping.py: using CellId 40696 11:50:04.952075 tst ping_idle_ping.py: using BVCI 40697 11:50:05.070802 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:05.082404 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:05.093965 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:05.105218 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:05.116899 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:05.128524 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:05.140394 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:05.152129 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:50:05.273604 tst ping_idle_ping.py:24: start network... 11:50:05.491266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:05.992352 run create_hlr_db(pid=18079): Launched 11:50:06.122933 bus /gobi_6: Setting Powered False 11:50:07.186909 run create_hlr_db(pid=18079): Terminated: ok {rc=0} 11:50:07.636827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18081): Launched 11:50:07.960630 run osmo-hlr_10.42.42.2(pid=18082): Launched 11:50:08.083644 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:08.637994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18084): Launched 11:50:08.960195 run osmo-stp_10.42.42.5(pid=18085): Launched 11:50:09.083669 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:09.639961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18087): Launched 11:50:09.764680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:10.037653 run patchelf(pid=18088): Launched 11:50:10.217774 run osmo-stp_10.42.42.5(pid=18085): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18085)] 11:50:10.354378 run osmo-stp_10.42.42.5(pid=18085): stdout: | (launched: 2022-12-14_11:50:08.900720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:10.492332 run osmo-stp_10.42.42.5(pid=18085): stderr: | [0;m[38;5;43m20221214115009089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115009089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115009089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115009090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115009090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115009090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115009090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:10.630808 run osmo-stp_10.42.42.5(pid=18085): stdout: | (launched: 2022-12-14_11:50:08.900720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:10.762255 run osmo-stp_10.42.42.5(pid=18085): stderr: | [0;m[38;5;43m20221214115009089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115009089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115009089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115009090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115009090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115009090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115009090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:10.918517 run patchelf(pid=18088): Terminating (SIGINT) 11:50:11.100639 run patchelf(pid=18088): Terminated: ok {rc=0} 11:50:11.231171 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18085): Process ended prematurely: osmo-stp_10.42.42.5(pid=18085) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18085)] [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 11:50:11.240736 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:50:11.268666 run osmo-hlr_10.42.42.2(pid=18082): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18082)] 11:50:11.318512 run osmo-hlr_10.42.42.2(pid=18082): stdout: | (launched: 2022-12-14_11:50:07.901467) 11:50:11.369959 run osmo-hlr_10.42.42.2(pid=18082): stderr: | [0;m[1;31m20221214115008096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115008096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115008096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115008096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115008096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115008096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115008109 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115008117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115008117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115008118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:11.421756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18081): Terminating (SIGTERM) 11:50:11.463501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18084): Terminating (SIGTERM) 11:50:11.505186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18087): Terminating (SIGTERM) 11:50:11.547415 --- ParallelTerminationStrategy: PID 18081 died... 11:50:11.567479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18081): Terminated: ok {rc=0} 11:50:11.613694 --- ParallelTerminationStrategy: PID 18084 died... 11:50:11.633211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18084): Terminated: ok {rc=0} 11:50:11.679246 --- ParallelTerminationStrategy: PID 18087 died... 11:50:11.698956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18087): Terminated: ok {rc=0} 11:50:11.787039 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:50:13.102836 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:50:13.110447 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:50:13.143983 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:50:13.183693 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:50:13.274151 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:50:13.308158 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:50:13.347448 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:50:13.943155 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:50:13.995470 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:14.006733 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:50:14.078130 tst cs_paging_gprs_active.py: using LAC 40697 11:50:14.199659 tst cs_paging_gprs_active.py: using RAC 152 11:50:14.320909 tst cs_paging_gprs_active.py: using CellId 40697 11:50:14.441584 tst cs_paging_gprs_active.py: using BVCI 40698 11:50:14.552430 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:14.563547 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:14.574256 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:14.584874 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:14.595784 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:14.606752 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:14.617882 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:14.628600 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:14.639638 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:50:14.760596 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:50:14.880117 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:50:15.086536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:15.394546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18092): Launched 11:50:15.661336 run iperf3-srv_10.42.42.10(pid=18093): Launched 11:50:15.776160 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:50:15.985746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:16.301434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18094): Launched 11:50:16.620090 run iperf3-srv_10.42.42.10(pid=18095): Launched 11:50:16.760624 tst cs_paging_gprs_active.py:38: start network... 11:50:16.970088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:17.449070 run create_hlr_db(pid=18096): Launched 11:50:17.567097 bus /gobi_6: Setting Powered False 11:50:18.627964 run create_hlr_db(pid=18096): Terminated: ok {rc=0} 11:50:19.073832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18098): Launched 11:50:19.401746 run osmo-hlr_10.42.42.2(pid=18099): Launched 11:50:19.526503 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:20.089939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18101): Launched 11:50:20.417152 run osmo-stp_10.42.42.5(pid=18102): Launched 11:50:20.541895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:21.106103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18104): Launched 11:50:21.231294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:21.507700 run patchelf(pid=18105): Launched 11:50:21.691031 run osmo-stp_10.42.42.5(pid=18102): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18102)] 11:50:21.829696 run osmo-stp_10.42.42.5(pid=18102): stdout: | (launched: 2022-12-14_11:50:20.357359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:21.971041 run osmo-stp_10.42.42.5(pid=18102): stderr: | [0;m[38;5;43m20221214115020545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115020545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115020546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115020546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115020547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115020547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115020547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:22.112111 run osmo-stp_10.42.42.5(pid=18102): stdout: | (launched: 2022-12-14_11:50:20.357359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:22.246388 run osmo-stp_10.42.42.5(pid=18102): stderr: | [0;m[38;5;43m20221214115020545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115020545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115020546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115020546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115020547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115020547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115020547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:22.405286 run patchelf(pid=18105): Terminating (SIGINT) 11:50:22.588486 run patchelf(pid=18105): Terminated: ok {rc=0} 11:50:22.720808 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18102): Process ended prematurely: osmo-stp_10.42.42.5(pid=18102) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18102)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:50:22.731071 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:50:22.759457 run osmo-hlr_10.42.42.2(pid=18099): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18099)] 11:50:22.809223 run osmo-hlr_10.42.42.2(pid=18099): stdout: | (launched: 2022-12-14_11:50:19.342031) 11:50:22.860624 run osmo-hlr_10.42.42.2(pid=18099): stderr: | [0;m[1;31m20221214115019535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115019535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115019535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115019535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115019535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115019535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115019548 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115019559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115019559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115019559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:22.912279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18092): Terminating (SIGTERM) 11:50:22.954172 run iperf3-srv_10.42.42.10(pid=18093): Terminating (SIGTERM) 11:50:22.996340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18094): Terminating (SIGTERM) 11:50:23.038083 run iperf3-srv_10.42.42.10(pid=18095): Terminating (SIGTERM) 11:50:23.080151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18098): Terminating (SIGTERM) 11:50:23.122333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18101): Terminating (SIGTERM) 11:50:23.164151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18104): Terminating (SIGTERM) 11:50:23.206112 --- ParallelTerminationStrategy: PID 18092 died... 11:50:23.225996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18092): Terminated: ok {rc=0} 11:50:23.271766 --- ParallelTerminationStrategy: PID 18093 died... 11:50:23.291123 run iperf3-srv_10.42.42.10(pid=18093): Terminated {rc=256} 11:50:23.336663 --- ParallelTerminationStrategy: PID 18094 died... 11:50:23.356078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18094): Terminated: ok {rc=0} 11:50:23.401732 --- ParallelTerminationStrategy: PID 18095 died... 11:50:23.421051 run iperf3-srv_10.42.42.10(pid=18095): Terminated {rc=256} 11:50:23.466368 --- ParallelTerminationStrategy: PID 18098 died... 11:50:23.485692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18098): Terminated: ok {rc=0} 11:50:23.531003 --- ParallelTerminationStrategy: PID 18101 died... 11:50:23.550396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18101): Terminated: ok {rc=0} 11:50:23.595797 --- ParallelTerminationStrategy: PID 18104 died... 11:50:23.615202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18104): Terminated: ok {rc=0} 11:50:23.702178 bus /gobi_0: Setting Powered False 11:50:24.801467 bus /gobi_0: Setting Powered False 11:50:25.915750 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:50:27.064565 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:27.076621 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:50:27.151573 tst iperf3.py: using LAC 40698 11:50:27.279603 tst iperf3.py: using RAC 153 11:50:27.409636 tst iperf3.py: using CellId 40698 11:50:27.537390 tst iperf3.py: using BVCI 40699 11:50:27.655564 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:27.667032 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:27.678173 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:27.689422 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:27.700487 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:27.711667 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:27.722866 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:27.733933 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:27.745251 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:50:27.862976 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:50:28.068369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:28.376057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18106): Launched 11:50:28.642931 run iperf3-srv_10.42.42.10(pid=18107): Launched 11:50:28.759819 tst iperf3.py:8: start network... 11:50:28.964130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:29.436928 run create_hlr_db(pid=18108): Launched 11:50:29.554192 bus /gobi_6: Setting Powered False 11:50:30.614403 run create_hlr_db(pid=18108): Terminated: ok {rc=0} 11:50:31.105737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18110): Launched 11:50:31.429740 run osmo-hlr_10.42.42.2(pid=18111): Launched 11:50:31.604128 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:32.262987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18113): Launched 11:50:32.603470 run osmo-stp_10.42.42.5(pid=18114): Launched 11:50:32.729568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:33.295368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18116): Launched 11:50:33.422010 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:33.699678 run patchelf(pid=18117): Launched 11:50:33.882143 run osmo-stp_10.42.42.5(pid=18114): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18114)] 11:50:34.020658 run osmo-stp_10.42.42.5(pid=18114): stdout: | (launched: 2022-12-14_11:50:32.543404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:34.162015 run osmo-stp_10.42.42.5(pid=18114): stderr: | [0;m[38;5;43m20221214115032731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115032731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115032731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115032731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115032732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115032732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115032732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:34.301928 run osmo-stp_10.42.42.5(pid=18114): stdout: | (launched: 2022-12-14_11:50:32.543404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:34.436275 run osmo-stp_10.42.42.5(pid=18114): stderr: | [0;m[38;5;43m20221214115032731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115032731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115032731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115032731 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115032732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115032732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115032732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:34.595399 run patchelf(pid=18117): Terminating (SIGINT) 11:50:34.778903 run patchelf(pid=18117): Terminated: ok {rc=0} 11:50:34.910790 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18114): Process ended prematurely: osmo-stp_10.42.42.5(pid=18114) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18114)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 11:50:34.921078 tst iperf3.py:8: Test FAILED (7.9 sec) 11:50:34.949912 run osmo-hlr_10.42.42.2(pid=18111): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18111)] 11:50:35.000618 run osmo-hlr_10.42.42.2(pid=18111): stdout: | (launched: 2022-12-14_11:50:31.369371) 11:50:35.053122 run osmo-hlr_10.42.42.2(pid=18111): stderr: | [0;m[1;31m20221214115031636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115031636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115031636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115031636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115031637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115031637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115031651 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115031667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115031667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115031667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:35.106380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18106): Terminating (SIGTERM) 11:50:35.148922 run iperf3-srv_10.42.42.10(pid=18107): Terminating (SIGTERM) 11:50:35.191215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18110): Terminating (SIGTERM) 11:50:35.234110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18113): Terminating (SIGTERM) 11:50:35.276380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18116): Terminating (SIGTERM) 11:50:35.319749 --- ParallelTerminationStrategy: PID 18106 died... 11:50:35.339986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18106): Terminated: ok {rc=0} 11:50:35.386674 --- ParallelTerminationStrategy: PID 18107 died... 11:50:35.406311 run iperf3-srv_10.42.42.10(pid=18107): Terminated {rc=256} 11:50:35.452309 --- ParallelTerminationStrategy: PID 18110 died... 11:50:35.472020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18110): Terminated: ok {rc=0} 11:50:35.518126 --- ParallelTerminationStrategy: PID 18113 died... 11:50:35.537782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18113): Terminated: ok {rc=0} 11:50:35.583816 --- ParallelTerminationStrategy: PID 18116 died... 11:50:35.603425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18116): Terminated: ok {rc=0} 11:50:35.690117 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:50:36.840763 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:36.853292 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:50:36.925747 tst iperf3m4.py: using LAC 40699 11:50:37.055634 tst iperf3m4.py: using RAC 154 11:50:37.185834 tst iperf3m4.py: using CellId 40699 11:50:37.307252 tst iperf3m4.py: using BVCI 40700 11:50:37.420400 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:37.431613 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:37.442733 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:37.453734 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:37.465610 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:37.477475 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:37.488460 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:37.499433 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:37.510235 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:50:37.631862 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:50:37.752314 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:50:37.871625 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:50:37.993681 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:50:38.216902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:38.547606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18118): Launched 11:50:38.835406 run iperf3-srv_10.42.42.10(pid=18119): Launched 11:50:38.959689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:50:39.181479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:39.510613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18120): Launched 11:50:39.797368 run iperf3-srv_10.42.42.10(pid=18121): Launched 11:50:39.919739 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:50:40.141123 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:40.470621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18122): Launched 11:50:40.756335 run iperf3-srv_10.42.42.10(pid=18123): Launched 11:50:40.879022 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:50:41.099122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:41.428692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18124): Launched 11:50:41.715808 run iperf3-srv_10.42.42.10(pid=18125): Launched 11:50:41.839596 tst iperf3m4.py:8: start network... 11:50:42.059687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:42.568474 run create_hlr_db(pid=18126): Launched 11:50:42.703437 bus /gobi_6: Setting Powered False 11:50:43.767233 run create_hlr_db(pid=18126): Terminated: ok {rc=0} 11:50:44.204772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18128): Launched 11:50:44.511244 run osmo-hlr_10.42.42.2(pid=18129): Launched 11:50:44.627606 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:45.165961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18131): Launched 11:50:45.471812 run osmo-stp_10.42.42.5(pid=18132): Launched 11:50:45.589245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:46.157770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18134): Launched 11:50:46.296697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:46.585700 run patchelf(pid=18135): Launched 11:50:46.770804 run osmo-stp_10.42.42.5(pid=18132): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18132)] 11:50:46.905481 run osmo-stp_10.42.42.5(pid=18132): stdout: | (launched: 2022-12-14_11:50:45.415244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:47.041074 run osmo-stp_10.42.42.5(pid=18132): stderr: | [0;m[38;5;43m20221214115045584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115045584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115045584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115045585 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115045585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115045585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115045586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:47.176436 run osmo-stp_10.42.42.5(pid=18132): stdout: | (launched: 2022-12-14_11:50:45.415244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:47.303593 run osmo-stp_10.42.42.5(pid=18132): stderr: | [0;m[38;5;43m20221214115045584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115045584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115045584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115045585 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115045585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115045585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115045586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:47.452524 run patchelf(pid=18135): Terminating (SIGINT) 11:50:47.626067 run patchelf(pid=18135): Terminated: ok {rc=0} 11:50:47.750301 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18132): Process ended prematurely: osmo-stp_10.42.42.5(pid=18132) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18132)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:50:47.760017 tst iperf3m4.py:8: Test FAILED (11.0 sec) 11:50:47.787845 run osmo-hlr_10.42.42.2(pid=18129): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18129)] 11:50:47.836200 run osmo-hlr_10.42.42.2(pid=18129): stdout: | (launched: 2022-12-14_11:50:44.454663) 11:50:47.886308 run osmo-hlr_10.42.42.2(pid=18129): stderr: | [0;m[1;31m20221214115044626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115044626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115044626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115044626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115044626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115044626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115044639 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115044647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115044648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115044648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:47.936294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18118): Terminating (SIGTERM) 11:50:47.976835 run iperf3-srv_10.42.42.10(pid=18119): Terminating (SIGTERM) 11:50:48.017357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18120): Terminating (SIGTERM) 11:50:48.057756 run iperf3-srv_10.42.42.10(pid=18121): Terminating (SIGTERM) 11:50:48.098036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18122): Terminating (SIGTERM) 11:50:48.138664 run iperf3-srv_10.42.42.10(pid=18123): Terminating (SIGTERM) 11:50:48.179987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18124): Terminating (SIGTERM) 11:50:48.220239 run iperf3-srv_10.42.42.10(pid=18125): Terminating (SIGTERM) 11:50:48.260799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18128): Terminating (SIGTERM) 11:50:48.301081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18131): Terminating (SIGTERM) 11:50:48.341395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18134): Terminating (SIGTERM) 11:50:48.382358 --- ParallelTerminationStrategy: PID 18118 died... 11:50:48.402108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18118): Terminated: ok {rc=0} 11:50:48.447376 --- ParallelTerminationStrategy: PID 18119 died... 11:50:48.466484 run iperf3-srv_10.42.42.10(pid=18119): Terminated {rc=256} 11:50:48.511127 --- ParallelTerminationStrategy: PID 18120 died... 11:50:48.530334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18120): Terminated: ok {rc=0} 11:50:48.575007 --- ParallelTerminationStrategy: PID 18121 died... 11:50:48.594252 run iperf3-srv_10.42.42.10(pid=18121): Terminated {rc=256} 11:50:48.638778 --- ParallelTerminationStrategy: PID 18122 died... 11:50:48.657980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18122): Terminated: ok {rc=0} 11:50:48.702631 --- ParallelTerminationStrategy: PID 18123 died... 11:50:48.722099 run iperf3-srv_10.42.42.10(pid=18123): Terminated {rc=256} 11:50:48.766671 --- ParallelTerminationStrategy: PID 18124 died... 11:50:48.785868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18124): Terminated: ok {rc=0} 11:50:48.830680 --- ParallelTerminationStrategy: PID 18125 died... 11:50:48.849884 run iperf3-srv_10.42.42.10(pid=18125): Terminated {rc=256} 11:50:48.898414 --- ParallelTerminationStrategy: PID 18128 died... 11:50:48.917192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18128): Terminated: ok {rc=0} 11:50:48.961121 --- ParallelTerminationStrategy: PID 18131 died... 11:50:48.980028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18131): Terminated: ok {rc=0} 11:50:49.024119 --- ParallelTerminationStrategy: PID 18134 died... 11:50:49.043077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18134): Terminated: ok {rc=0} 11:50:49.129377 bus /gobi_4: Setting Powered False 11:50:50.231235 bus /gobi_4: Setting Powered False 11:50:51.351592 bus /gobi_1: Setting Powered False 11:50:52.451524 bus /gobi_1: Setting Powered False 11:50:53.568061 bus /gobi_0: Setting Powered False 11:50:54.666761 bus /gobi_0: Setting Powered False 11:50:55.785375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:50:56.888649 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:56.900307 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:50:56.973353 tst ping.py: using LAC 40700 11:50:57.089932 tst ping.py: using RAC 155 11:50:57.206935 tst ping.py: using CellId 40700 11:50:57.320665 tst ping.py: using BVCI 40701 11:50:57.427643 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:57.438606 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:57.449398 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:57.460138 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:57.470951 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:57.481951 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:57.493018 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:50:57.503954 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:50:57.623999 tst ping.py:19: start network... 11:50:57.838592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:58.332222 run create_hlr_db(pid=18136): Launched 11:50:58.461008 bus /gobi_6: Setting Powered False 11:50:59.524582 run create_hlr_db(pid=18136): Terminated: ok {rc=0} 11:50:59.969097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18138): Launched 11:51:00.288001 run osmo-hlr_10.42.42.2(pid=18139): Launched 11:51:00.407598 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:00.968936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18141): Launched 11:51:01.306710 run osmo-stp_10.42.42.5(pid=18142): Launched 11:51:01.552612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:02.121767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18144): Launched 11:51:02.257549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:02.529141 run patchelf(pid=18145): Launched 11:51:02.705670 run osmo-stp_10.42.42.5(pid=18142): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18142)] 11:51:02.841089 run osmo-stp_10.42.42.5(pid=18142): stdout: | (launched: 2022-12-14_11:51:01.243291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:02.978121 run osmo-stp_10.42.42.5(pid=18142): stderr: | [0;m[38;5;43m20221214115101425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115101425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115101425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115101426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115101426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115101426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115101426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:03.115741 run osmo-stp_10.42.42.5(pid=18142): stdout: | (launched: 2022-12-14_11:51:01.243291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:03.246562 run osmo-stp_10.42.42.5(pid=18142): stderr: | [0;m[38;5;43m20221214115101425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115101425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115101425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115101426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115101426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115101426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115101426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:03.400836 run patchelf(pid=18145): Terminating (SIGINT) 11:51:03.579548 run patchelf(pid=18145): Terminated: ok {rc=0} 11:51:03.707861 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18142): Process ended prematurely: osmo-stp_10.42.42.5(pid=18142) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18142)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 11:51:03.717353 tst ping.py:22: Test FAILED (6.8 sec) 11:51:03.745313 run osmo-hlr_10.42.42.2(pid=18139): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18139)] 11:51:03.795348 run osmo-hlr_10.42.42.2(pid=18139): stdout: | (launched: 2022-12-14_11:51:00.228848) 11:51:03.847053 run osmo-hlr_10.42.42.2(pid=18139): stderr: | [0;m[1;31m20221214115100422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115100422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115100422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115100422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115100422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115100422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115100437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115100445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115100445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115100445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:03.899110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18138): Terminating (SIGTERM) 11:51:03.941220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18141): Terminating (SIGTERM) 11:51:03.983314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18144): Terminating (SIGTERM) 11:51:04.025600 --- ParallelTerminationStrategy: PID 18138 died... 11:51:04.045785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18138): Terminated: ok {rc=0} 11:51:04.091831 --- ParallelTerminationStrategy: PID 18141 died... 11:51:04.111601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18141): Terminated: ok {rc=0} 11:51:04.157705 --- ParallelTerminationStrategy: PID 18144 died... 11:51:04.177453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18144): Terminated: ok {rc=0} 11:51:04.265070 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:51:05.355385 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:05.368001 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:51:05.441478 tst ping_idle_ping.py: using LAC 40701 11:51:05.568067 tst ping_idle_ping.py: using RAC 156 11:51:05.692882 tst ping_idle_ping.py: using CellId 40701 11:51:05.817370 tst ping_idle_ping.py: using BVCI 40702 11:51:05.933124 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:05.944541 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:05.955750 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:05.967069 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:05.978423 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:05.989820 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:06.001342 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:06.012661 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:51:06.128773 tst ping_idle_ping.py:24: start network... 11:51:06.331165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:06.800792 run create_hlr_db(pid=18146): Launched 11:51:06.914768 bus /gobi_6: Setting Powered False 11:51:07.973916 run create_hlr_db(pid=18146): Terminated: ok {rc=0} 11:51:08.413581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18148): Launched 11:51:08.731637 run osmo-hlr_10.42.42.2(pid=18149): Launched 11:51:08.852294 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:09.402754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18151): Launched 11:51:09.721195 run osmo-stp_10.42.42.5(pid=18152): Launched 11:51:09.841629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:10.392108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18154): Launched 11:51:10.513908 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:10.783378 run patchelf(pid=18155): Launched 11:51:10.960270 run osmo-stp_10.42.42.5(pid=18152): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18152)] 11:51:11.095454 run osmo-stp_10.42.42.5(pid=18152): stdout: | (launched: 2022-12-14_11:51:09.662470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:11.233217 run osmo-stp_10.42.42.5(pid=18152): stderr: | [0;m[38;5;43m20221214115109851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115109851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115109851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115109851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115109852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115109852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115109852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:11.369924 run osmo-stp_10.42.42.5(pid=18152): stdout: | (launched: 2022-12-14_11:51:09.662470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:11.500463 run osmo-stp_10.42.42.5(pid=18152): stderr: | [0;m[38;5;43m20221214115109851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115109851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115109851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115109851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115109852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115109852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115109852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:11.654753 run patchelf(pid=18155): Terminating (SIGINT) 11:51:11.832750 run patchelf(pid=18155): Terminated: ok {rc=0} 11:51:11.961851 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18152): Process ended prematurely: osmo-stp_10.42.42.5(pid=18152) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18152)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:51:11.971519 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 11:51:11.999398 run osmo-hlr_10.42.42.2(pid=18149): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18149)] 11:51:12.049400 run osmo-hlr_10.42.42.2(pid=18149): stdout: | (launched: 2022-12-14_11:51:08.673376) 11:51:12.100809 run osmo-hlr_10.42.42.2(pid=18149): stderr: | [0;m[1;31m20221214115108866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115108866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115108866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115108866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115108866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115108866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115108878 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115108888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115108888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115108888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:12.153417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18148): Terminating (SIGTERM) 11:51:12.195177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18151): Terminating (SIGTERM) 11:51:12.237367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18154): Terminating (SIGTERM) 11:51:12.279173 --- ParallelTerminationStrategy: PID 18148 died... 11:51:12.299052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18148): Terminated: ok {rc=0} 11:51:12.345418 --- ParallelTerminationStrategy: PID 18151 died... 11:51:12.364814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18151): Terminated: ok {rc=0} 11:51:12.410620 --- ParallelTerminationStrategy: PID 18154 died... 11:51:12.430397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18154): Terminated: ok {rc=0} 11:51:12.518228 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:51:13.827126 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:13.833608 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:51:13.867352 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:51:13.907806 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:51:13.995463 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:51:14.029078 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:51:14.068538 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:51:14.666856 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:51:14.719689 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:14.731003 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:51:14.801917 tst cs_paging_gprs_active.py: using LAC 40702 11:51:14.926915 tst cs_paging_gprs_active.py: using RAC 157 11:51:15.052744 tst cs_paging_gprs_active.py: using CellId 40702 11:51:15.178264 tst cs_paging_gprs_active.py: using BVCI 40703 11:51:15.296084 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:15.307461 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:15.318684 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:15.329859 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:15.341344 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:15.352927 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:15.364678 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:15.376314 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:15.388095 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:51:15.507032 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:51:15.628813 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:51:15.848408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:16.185575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18161): Launched 11:51:16.489766 run iperf3-srv_10.42.42.10(pid=18162): Launched 11:51:16.623944 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:51:16.847762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:17.184381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18163): Launched 11:51:17.459302 run iperf3-srv_10.42.42.10(pid=18164): Launched 11:51:17.573965 tst cs_paging_gprs_active.py:38: start network... 11:51:17.776810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:18.247450 run create_hlr_db(pid=18165): Launched 11:51:18.363409 bus /gobi_6: Setting Powered False 11:51:19.423748 run create_hlr_db(pid=18165): Terminated: ok {rc=0} 11:51:19.847417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18167): Launched 11:51:20.151434 run osmo-hlr_10.42.42.2(pid=18168): Launched 11:51:20.266460 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:20.790765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18170): Launched 11:51:21.093916 run osmo-stp_10.42.42.5(pid=18171): Launched 11:51:21.209182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:21.733384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18173): Launched 11:51:21.850140 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:22.108016 run patchelf(pid=18174): Launched 11:51:22.276431 run osmo-stp_10.42.42.5(pid=18171): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18171)] 11:51:22.405289 run osmo-stp_10.42.42.5(pid=18171): stdout: | (launched: 2022-12-14_11:51:21.037595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:22.536445 run osmo-stp_10.42.42.5(pid=18171): stderr: | [0;m[38;5;43m20221214115121207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115121207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115121207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115121207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115121208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115121208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115121208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:22.666894 run osmo-stp_10.42.42.5(pid=18171): stdout: | (launched: 2022-12-14_11:51:21.037595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:22.791216 run osmo-stp_10.42.42.5(pid=18171): stderr: | [0;m[38;5;43m20221214115121207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115121207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115121207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115121207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115121208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115121208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115121208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:22.938741 run patchelf(pid=18174): Terminating (SIGINT) 11:51:23.108929 run patchelf(pid=18174): Terminated: ok {rc=0} 11:51:23.232103 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18171): Process ended prematurely: osmo-stp_10.42.42.5(pid=18171) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18171)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:51:23.241700 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:51:23.268313 run osmo-hlr_10.42.42.2(pid=18168): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18168)] 11:51:23.316802 run osmo-hlr_10.42.42.2(pid=18168): stdout: | (launched: 2022-12-14_11:51:20.094550) 11:51:23.366414 run osmo-hlr_10.42.42.2(pid=18168): stderr: | [0;m[1;31m20221214115120267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115120267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115120268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115120268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115120268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115120268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115120280 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115120287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115120288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115120288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:23.416151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18161): Terminating (SIGTERM) 11:51:23.456371 run iperf3-srv_10.42.42.10(pid=18162): Terminating (SIGTERM) 11:51:23.496294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18163): Terminating (SIGTERM) 11:51:23.536264 run iperf3-srv_10.42.42.10(pid=18164): Terminating (SIGTERM) 11:51:23.576252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18167): Terminating (SIGTERM) 11:51:23.616262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18170): Terminating (SIGTERM) 11:51:23.656430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18173): Terminating (SIGTERM) 11:51:23.696826 --- ParallelTerminationStrategy: PID 18161 died... 11:51:23.716212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18161): Terminated: ok {rc=0} 11:51:23.760126 --- ParallelTerminationStrategy: PID 18162 died... 11:51:23.779068 run iperf3-srv_10.42.42.10(pid=18162): Terminated {rc=256} 11:51:23.822879 --- ParallelTerminationStrategy: PID 18163 died... 11:51:23.841803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18163): Terminated: ok {rc=0} 11:51:23.885350 --- ParallelTerminationStrategy: PID 18164 died... 11:51:23.903758 run iperf3-srv_10.42.42.10(pid=18164): Terminated {rc=256} 11:51:23.947265 --- ParallelTerminationStrategy: PID 18167 died... 11:51:23.965951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18167): Terminated: ok {rc=0} 11:51:24.009852 --- ParallelTerminationStrategy: PID 18170 died... 11:51:24.028687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18170): Terminated: ok {rc=0} 11:51:24.072168 --- ParallelTerminationStrategy: PID 18173 died... 11:51:24.091108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18173): Terminated: ok {rc=0} 11:51:24.176723 bus /gobi_0: Setting Powered False 11:51:25.275455 bus /gobi_0: Setting Powered False 11:51:26.390579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:51:27.535881 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:27.547361 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:51:27.618898 tst iperf3.py: using LAC 40703 11:51:27.739077 tst iperf3.py: using RAC 158 11:51:27.863898 tst iperf3.py: using CellId 40703 11:51:27.981810 tst iperf3.py: using BVCI 40704 11:51:28.090874 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:28.101759 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:28.112422 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:28.123039 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:28.133965 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:28.145014 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:28.156212 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:28.167084 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:28.178196 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:51:28.298571 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:51:28.519013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:28.846012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18175): Launched 11:51:29.129390 run iperf3-srv_10.42.42.10(pid=18176): Launched 11:51:29.250797 tst iperf3.py:8: start network... 11:51:29.469545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:29.973191 run create_hlr_db(pid=18177): Launched 11:51:30.104830 bus /gobi_6: Setting Powered False 11:51:31.182595 run create_hlr_db(pid=18177): Terminated: ok {rc=0} 11:51:31.741518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18179): Launched 11:51:32.101717 run osmo-hlr_10.42.42.2(pid=18180): Launched 11:51:32.281211 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:32.874078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18182): Launched 11:51:33.199335 run osmo-stp_10.42.42.5(pid=18183): Launched 11:51:33.322272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:33.881954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18185): Launched 11:51:34.006172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:34.282019 run patchelf(pid=18186): Launched 11:51:34.461670 run osmo-stp_10.42.42.5(pid=18183): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18183)] 11:51:34.598532 run osmo-stp_10.42.42.5(pid=18183): stdout: | (launched: 2022-12-14_11:51:33.138858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:34.737217 run osmo-stp_10.42.42.5(pid=18183): stderr: | [0;m[38;5;43m20221214115133328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115133328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115133328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115133329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115133329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115133329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115133329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:34.875462 run osmo-stp_10.42.42.5(pid=18183): stdout: | (launched: 2022-12-14_11:51:33.138858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:35.007780 run osmo-stp_10.42.42.5(pid=18183): stderr: | [0;m[38;5;43m20221214115133328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115133328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115133328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115133329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115133329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115133329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115133329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:35.165322 run patchelf(pid=18186): Terminating (SIGINT) 11:51:35.346332 run patchelf(pid=18186): Terminated: ok {rc=0} 11:51:35.476797 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18183): Process ended prematurely: osmo-stp_10.42.42.5(pid=18183) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18183)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 11:51:35.487119 tst iperf3.py:8: Test FAILED (8.0 sec) 11:51:35.515320 run osmo-hlr_10.42.42.2(pid=18180): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18180)] 11:51:35.565182 run osmo-hlr_10.42.42.2(pid=18180): stdout: | (launched: 2022-12-14_11:51:32.021021) 11:51:35.617011 run osmo-hlr_10.42.42.2(pid=18180): stderr: | [0;m[1;31m20221214115132353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115132354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115132354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115132354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115132354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115132354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115132369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115132380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115132380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115132380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:35.668612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18175): Terminating (SIGTERM) 11:51:35.710298 run iperf3-srv_10.42.42.10(pid=18176): Terminating (SIGTERM) 11:51:35.752122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18179): Terminating (SIGTERM) 11:51:35.794366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18182): Terminating (SIGTERM) 11:51:35.836277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18185): Terminating (SIGTERM) 11:51:35.878740 --- ParallelTerminationStrategy: PID 18175 died... 11:51:35.898585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18175): Terminated: ok {rc=0} 11:51:35.944880 --- ParallelTerminationStrategy: PID 18176 died... 11:51:35.964778 run iperf3-srv_10.42.42.10(pid=18176): Terminated {rc=256} 11:51:36.010148 --- ParallelTerminationStrategy: PID 18179 died... 11:51:36.029537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18179): Terminated: ok {rc=0} 11:51:36.075155 --- ParallelTerminationStrategy: PID 18182 died... 11:51:36.094661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18182): Terminated: ok {rc=0} 11:51:36.140667 --- ParallelTerminationStrategy: PID 18185 died... 11:51:36.160071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18185): Terminated: ok {rc=0} 11:51:36.247162 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:51:37.397515 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:37.409500 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:51:37.482080 tst iperf3m4.py: using LAC 40704 11:51:37.604532 tst iperf3m4.py: using RAC 159 11:51:37.723433 tst iperf3m4.py: using CellId 40704 11:51:37.848159 tst iperf3m4.py: using BVCI 40705 11:51:37.959914 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:37.971063 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:37.982069 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:37.992942 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:38.004501 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:38.015873 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:38.027315 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:38.038931 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:38.050453 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:51:38.172240 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:51:38.291521 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:51:38.412399 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:51:38.529582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:51:38.734619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:39.039846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18187): Launched 11:51:39.305171 run iperf3-srv_10.42.42.10(pid=18188): Launched 11:51:39.419477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:51:39.622957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:39.927815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18189): Launched 11:51:40.193379 run iperf3-srv_10.42.42.10(pid=18190): Launched 11:51:40.307318 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:51:40.509743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:40.814991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18191): Launched 11:51:41.079185 run iperf3-srv_10.42.42.10(pid=18192): Launched 11:51:41.193213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:51:41.395506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:41.700215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18193): Launched 11:51:41.965452 run iperf3-srv_10.42.42.10(pid=18194): Launched 11:51:42.079178 tst iperf3m4.py:8: start network... 11:51:42.281178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:42.750250 run create_hlr_db(pid=18195): Launched 11:51:42.865436 bus /gobi_6: Setting Powered False 11:51:43.925924 run create_hlr_db(pid=18195): Terminated: ok {rc=0} 11:51:44.371574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18197): Launched 11:51:44.698400 run osmo-hlr_10.42.42.2(pid=18198): Launched 11:51:44.821806 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:45.386142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18200): Launched 11:51:45.710632 run osmo-stp_10.42.42.5(pid=18201): Launched 11:51:45.835673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:46.508120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18203): Launched 11:51:46.642123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:46.913567 run patchelf(pid=18204): Launched 11:51:47.105569 run osmo-stp_10.42.42.5(pid=18201): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18201)] 11:51:47.240640 run osmo-stp_10.42.42.5(pid=18201): stdout: | (launched: 2022-12-14_11:51:45.650650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:47.374622 run osmo-stp_10.42.42.5(pid=18201): stderr: | [0;m[38;5;43m20221214115145859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115145859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115145859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115145860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115145860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115145860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115145860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:47.507546 run osmo-stp_10.42.42.5(pid=18201): stdout: | (launched: 2022-12-14_11:51:45.650650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:47.634567 run osmo-stp_10.42.42.5(pid=18201): stderr: | [0;m[38;5;43m20221214115145859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115145859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115145859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115145860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115145860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115145860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115145860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:47.783989 run patchelf(pid=18204): Terminating (SIGINT) 11:51:47.957172 run patchelf(pid=18204): Terminated: ok {rc=0} 11:51:48.081311 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18201): Process ended prematurely: osmo-stp_10.42.42.5(pid=18201) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18201)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:51:48.090980 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:51:48.118699 run osmo-hlr_10.42.42.2(pid=18198): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18198)] 11:51:48.167517 run osmo-hlr_10.42.42.2(pid=18198): stdout: | (launched: 2022-12-14_11:51:44.638099) 11:51:48.217312 run osmo-hlr_10.42.42.2(pid=18198): stderr: | [0;m[1;31m20221214115144834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115144834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115144834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115144834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115144834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115144834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115144847 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115144855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115144855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115144856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:48.268011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18187): Terminating (SIGTERM) 11:51:48.308302 run iperf3-srv_10.42.42.10(pid=18188): Terminating (SIGTERM) 11:51:48.349110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18189): Terminating (SIGTERM) 11:51:48.390127 run iperf3-srv_10.42.42.10(pid=18190): Terminating (SIGTERM) 11:51:48.430659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18191): Terminating (SIGTERM) 11:51:48.471058 run iperf3-srv_10.42.42.10(pid=18192): Terminating (SIGTERM) 11:51:48.511302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18193): Terminating (SIGTERM) 11:51:48.551674 run iperf3-srv_10.42.42.10(pid=18194): Terminating (SIGTERM) 11:51:48.591794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18197): Terminating (SIGTERM) 11:51:48.632481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18200): Terminating (SIGTERM) 11:51:48.673276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18203): Terminating (SIGTERM) 11:51:48.714554 --- ParallelTerminationStrategy: PID 18187 died... 11:51:48.734156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18187): Terminated: ok {rc=0} 11:51:48.779494 --- ParallelTerminationStrategy: PID 18188 died... 11:51:48.799048 run iperf3-srv_10.42.42.10(pid=18188): Terminated {rc=256} 11:51:48.843892 --- ParallelTerminationStrategy: PID 18189 died... 11:51:48.863291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18189): Terminated: ok {rc=0} 11:51:48.908248 --- ParallelTerminationStrategy: PID 18190 died... 11:51:48.927653 run iperf3-srv_10.42.42.10(pid=18190): Terminated {rc=256} 11:51:48.972330 --- ParallelTerminationStrategy: PID 18191 died... 11:51:48.992107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18191): Terminated: ok {rc=0} 11:51:49.037091 --- ParallelTerminationStrategy: PID 18192 died... 11:51:49.056401 run iperf3-srv_10.42.42.10(pid=18192): Terminated {rc=256} 11:51:49.101085 --- ParallelTerminationStrategy: PID 18193 died... 11:51:49.120400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18193): Terminated: ok {rc=0} 11:51:49.165415 --- ParallelTerminationStrategy: PID 18194 died... 11:51:49.184715 run iperf3-srv_10.42.42.10(pid=18194): Terminated {rc=256} 11:51:49.229621 --- ParallelTerminationStrategy: PID 18197 died... 11:51:49.249010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18197): Terminated: ok {rc=0} 11:51:49.293971 --- ParallelTerminationStrategy: PID 18200 died... 11:51:49.313440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18200): Terminated: ok {rc=0} 11:51:49.358570 --- ParallelTerminationStrategy: PID 18203 died... 11:51:49.378222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18203): Terminated: ok {rc=0} 11:51:49.465826 bus /gobi_4: Setting Powered False 11:51:50.567783 bus /gobi_4: Setting Powered False 11:51:51.684689 bus /gobi_1: Setting Powered False 11:51:52.782085 bus /gobi_1: Setting Powered False 11:51:53.899051 bus /gobi_0: Setting Powered False 11:51:54.999184 bus /gobi_0: Setting Powered False 11:51:56.116805 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:51:57.222932 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:57.235150 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:51:57.307467 tst ping.py: using LAC 40705 11:51:57.436856 tst ping.py: using RAC 160 11:51:57.564253 tst ping.py: using CellId 40705 11:51:57.691170 tst ping.py: using BVCI 40706 11:51:57.809209 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:57.820793 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:57.832158 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:57.843520 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:57.854923 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:57.866323 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:57.877782 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:51:57.889262 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:51:58.008882 tst ping.py:19: start network... 11:51:58.227424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:58.728170 run create_hlr_db(pid=18205): Launched 11:51:58.858288 bus /gobi_6: Setting Powered False 11:51:59.922528 run create_hlr_db(pid=18205): Terminated: ok {rc=0} 11:52:00.374767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18207): Launched 11:52:00.698662 run osmo-hlr_10.42.42.2(pid=18208): Launched 11:52:00.823648 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:01.433084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18210): Launched 11:52:01.757878 run osmo-stp_10.42.42.5(pid=18211): Launched 11:52:01.938555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:02.621960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18213): Launched 11:52:02.746075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:03.017879 run patchelf(pid=18214): Launched 11:52:03.199297 run osmo-stp_10.42.42.5(pid=18211): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18211)] 11:52:03.335955 run osmo-stp_10.42.42.5(pid=18211): stdout: | (launched: 2022-12-14_11:52:01.700903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:03.475246 run osmo-stp_10.42.42.5(pid=18211): stderr: | [0;m[38;5;43m20221214115202089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115202089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115202089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115202090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115202090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115202090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115202090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:03.614146 run osmo-stp_10.42.42.5(pid=18211): stdout: | (launched: 2022-12-14_11:52:01.700903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:03.746355 run osmo-stp_10.42.42.5(pid=18211): stderr: | [0;m[38;5;43m20221214115202089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115202089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115202089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115202090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115202090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115202090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115202090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:03.902754 run patchelf(pid=18214): Terminating (SIGINT) 11:52:04.082704 run patchelf(pid=18214): Terminated: ok {rc=0} 11:52:04.213312 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18211): Process ended prematurely: osmo-stp_10.42.42.5(pid=18211) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18211)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 11:52:04.222909 tst ping.py:22: Test FAILED (7.0 sec) 11:52:04.250981 run osmo-hlr_10.42.42.2(pid=18208): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18208)] 11:52:04.300722 run osmo-hlr_10.42.42.2(pid=18208): stdout: | (launched: 2022-12-14_11:52:00.638891) 11:52:04.352469 run osmo-hlr_10.42.42.2(pid=18208): stderr: | [0;m[1;31m20221214115200836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115200836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115200836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115200837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115200837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115200837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115200854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115200873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115200874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115200874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:04.404722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18207): Terminating (SIGTERM) 11:52:04.446303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18210): Terminating (SIGTERM) 11:52:04.488510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18213): Terminating (SIGTERM) 11:52:04.530737 --- ParallelTerminationStrategy: PID 18207 died... 11:52:04.550830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18207): Terminated: ok {rc=0} 11:52:04.597093 --- ParallelTerminationStrategy: PID 18210 died... 11:52:04.616680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18210): Terminated: ok {rc=0} 11:52:04.662724 --- ParallelTerminationStrategy: PID 18213 died... 11:52:04.682746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18213): Terminated: ok {rc=0} 11:52:04.771190 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:52:05.859486 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:05.871601 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:52:05.944092 tst ping_idle_ping.py: using LAC 40706 11:52:06.071664 tst ping_idle_ping.py: using RAC 161 11:52:06.198140 tst ping_idle_ping.py: using CellId 40706 11:52:06.324718 tst ping_idle_ping.py: using BVCI 40707 11:52:06.441778 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:06.453146 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:06.464254 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:06.475577 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:06.486637 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:06.497852 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:06.509139 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:06.520335 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:52:06.640718 tst ping_idle_ping.py:24: start network... 11:52:06.859085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:07.363150 run create_hlr_db(pid=18216): Launched 11:52:07.493653 bus /gobi_6: Setting Powered False 11:52:08.557540 run create_hlr_db(pid=18216): Terminated: ok {rc=0} 11:52:09.011316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18218): Launched 11:52:09.337270 run osmo-hlr_10.42.42.2(pid=18219): Launched 11:52:09.460880 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:10.022973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18221): Launched 11:52:10.348552 run osmo-stp_10.42.42.5(pid=18222): Launched 11:52:10.472042 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:11.029795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18224): Launched 11:52:11.153739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:11.427762 run patchelf(pid=18225): Launched 11:52:11.608789 run osmo-stp_10.42.42.5(pid=18222): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18222)] 11:52:11.745621 run osmo-stp_10.42.42.5(pid=18222): stdout: | (launched: 2022-12-14_11:52:10.288750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:11.884080 run osmo-stp_10.42.42.5(pid=18222): stderr: | [0;m[38;5;43m20221214115210478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115210478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115210479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115210479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115210479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115210479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115210480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:12.022678 run osmo-stp_10.42.42.5(pid=18222): stdout: | (launched: 2022-12-14_11:52:10.288750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:12.155559 run osmo-stp_10.42.42.5(pid=18222): stderr: | [0;m[38;5;43m20221214115210478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115210478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115210479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115210479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115210479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115210479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115210480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:12.312258 run patchelf(pid=18225): Terminating (SIGINT) 11:52:12.493599 run patchelf(pid=18225): Terminated: ok {rc=0} 11:52:12.623693 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18222): Process ended prematurely: osmo-stp_10.42.42.5(pid=18222) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18222)] [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:52:12.633301 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:52:12.661255 run osmo-hlr_10.42.42.2(pid=18219): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18219)] 11:52:12.711174 run osmo-hlr_10.42.42.2(pid=18219): stdout: | (launched: 2022-12-14_11:52:09.277504) 11:52:12.762900 run osmo-hlr_10.42.42.2(pid=18219): stderr: | [0;m[1;31m20221214115209475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115209475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115209475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115209475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115209475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115209475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115209488 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115209496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115209496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115209496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:12.815047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18218): Terminating (SIGTERM) 11:52:12.857526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18221): Terminating (SIGTERM) 11:52:12.899642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18224): Terminating (SIGTERM) 11:52:12.941859 --- ParallelTerminationStrategy: PID 18218 died... 11:52:12.961847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18218): Terminated: ok {rc=0} 11:52:13.008229 --- ParallelTerminationStrategy: PID 18221 died... 11:52:13.028081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18221): Terminated: ok {rc=0} 11:52:13.074725 --- ParallelTerminationStrategy: PID 18224 died... 11:52:13.094579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18224): Terminated: ok {rc=0} 11:52:13.183119 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:52:14.496426 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:52:14.504339 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:52:14.539165 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 11:52:14.578083 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 11:52:14.665759 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:52:14.698510 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 11:52:14.736920 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 11:52:15.335065 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 11:52:15.385439 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:15.396877 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:52:15.448864 tst cs_paging_gprs_active.py: using LAC 40707 11:52:15.570454 tst cs_paging_gprs_active.py: using RAC 162 11:52:15.692686 tst cs_paging_gprs_active.py: using CellId 40707 11:52:15.814038 tst cs_paging_gprs_active.py: using BVCI 40708 11:52:15.942722 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:15.955219 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:15.967331 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:15.979397 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:15.992731 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:16.006069 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:16.019361 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:16.035116 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:16.050053 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:52:16.190765 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:52:16.316270 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:52:16.545147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:16.887870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18229): Launched 11:52:17.194085 run iperf3-srv_10.42.42.10(pid=18230): Launched 11:52:17.324128 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:52:17.530499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:17.841359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18231): Launched 11:52:18.110888 run iperf3-srv_10.42.42.10(pid=18232): Launched 11:52:18.228449 tst cs_paging_gprs_active.py:38: start network... 11:52:18.434249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:18.911110 run create_hlr_db(pid=18233): Launched 11:52:19.032007 bus /gobi_6: Setting Powered False 11:52:20.093735 run create_hlr_db(pid=18233): Terminated: ok {rc=0} 11:52:20.522856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18235): Launched 11:52:20.832232 run osmo-hlr_10.42.42.2(pid=18236): Launched 11:52:20.949938 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:21.482887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18238): Launched 11:52:21.790868 run osmo-stp_10.42.42.5(pid=18239): Launched 11:52:21.909139 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:22.440829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18241): Launched 11:52:22.558630 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:22.819215 run patchelf(pid=18242): Launched 11:52:23.004290 run osmo-stp_10.42.42.5(pid=18239): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18239)] 11:52:23.144224 run osmo-stp_10.42.42.5(pid=18239): stdout: | (launched: 2022-12-14_11:52:21.733914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:23.286465 run osmo-stp_10.42.42.5(pid=18239): stderr: | [0;m[38;5;43m20221214115221902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115221902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115221903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115221903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115221903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115221903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115221904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:23.428443 run osmo-stp_10.42.42.5(pid=18239): stdout: | (launched: 2022-12-14_11:52:21.733914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:23.564305 run osmo-stp_10.42.42.5(pid=18239): stderr: | [0;m[38;5;43m20221214115221902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115221902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115221903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115221903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115221903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115221903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115221904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:23.725685 run patchelf(pid=18242): Terminating (SIGINT) 11:52:23.910845 run patchelf(pid=18242): Terminated: ok {rc=0} 11:52:24.044305 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18239): Process ended prematurely: osmo-stp_10.42.42.5(pid=18239) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18239)] [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 11:52:24.054728 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:52:24.083750 run osmo-hlr_10.42.42.2(pid=18236): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18236)] 11:52:24.134639 run osmo-hlr_10.42.42.2(pid=18236): stdout: | (launched: 2022-12-14_11:52:20.775201) 11:52:24.187878 run osmo-hlr_10.42.42.2(pid=18236): stderr: | [0;m[1;31m20221214115220949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115220949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115220949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115220949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115220949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115220949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115220962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115220970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115220970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115220970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:24.240840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18229): Terminating (SIGTERM) 11:52:24.283524 run iperf3-srv_10.42.42.10(pid=18230): Terminating (SIGTERM) 11:52:24.326578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18231): Terminating (SIGTERM) 11:52:24.369667 run iperf3-srv_10.42.42.10(pid=18232): Terminating (SIGTERM) 11:52:24.412588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18235): Terminating (SIGTERM) 11:52:24.455485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18238): Terminating (SIGTERM) 11:52:24.498017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18241): Terminating (SIGTERM) 11:52:24.540451 --- ParallelTerminationStrategy: PID 18229 died... 11:52:24.561010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18229): Terminated: ok {rc=0} 11:52:24.608092 --- ParallelTerminationStrategy: PID 18230 died... 11:52:24.628040 run iperf3-srv_10.42.42.10(pid=18230): Terminated {rc=256} 11:52:24.674656 --- ParallelTerminationStrategy: PID 18231 died... 11:52:24.694716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18231): Terminated: ok {rc=0} 11:52:24.741280 --- ParallelTerminationStrategy: PID 18232 died... 11:52:24.761081 run iperf3-srv_10.42.42.10(pid=18232): Terminated {rc=256} 11:52:24.807456 --- ParallelTerminationStrategy: PID 18235 died... 11:52:24.827226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18235): Terminated: ok {rc=0} 11:52:24.873719 --- ParallelTerminationStrategy: PID 18238 died... 11:52:24.893554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18238): Terminated: ok {rc=0} 11:52:24.940581 --- ParallelTerminationStrategy: PID 18241 died... 11:52:24.960495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18241): Terminated: ok {rc=0} 11:52:25.049857 bus /gobi_0: Setting Powered False 11:52:26.150821 bus /gobi_0: Setting Powered False 11:52:27.268629 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 11:52:28.418887 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:28.431289 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:52:28.488913 tst iperf3.py: using LAC 40708 11:52:28.618453 tst iperf3.py: using RAC 163 11:52:28.748791 tst iperf3.py: using CellId 40708 11:52:28.877086 tst iperf3.py: using BVCI 40709 11:52:28.997378 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:29.009152 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:29.020758 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:29.032309 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:29.043902 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:29.055458 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:29.067238 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:29.078702 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:29.090394 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:52:29.208296 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:52:29.417313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:29.728768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18243): Launched 11:52:29.998547 run iperf3-srv_10.42.42.10(pid=18244): Launched 11:52:30.116248 tst iperf3.py:8: start network... 11:52:30.322684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:30.798892 run create_hlr_db(pid=18245): Launched 11:52:30.920374 bus /gobi_6: Setting Powered False 11:52:31.981138 run create_hlr_db(pid=18245): Terminated: ok {rc=0} 11:52:32.420199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18247): Launched 11:52:32.729227 run osmo-hlr_10.42.42.2(pid=18248): Launched 11:52:32.846104 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:33.378419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18250): Launched 11:52:33.709241 run osmo-stp_10.42.42.5(pid=18251): Launched 11:52:33.835134 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:34.403253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18253): Launched 11:52:34.530416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:34.808854 run patchelf(pid=18254): Launched 11:52:34.993861 run osmo-stp_10.42.42.5(pid=18251): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18251)] 11:52:35.133606 run osmo-stp_10.42.42.5(pid=18251): stdout: | (launched: 2022-12-14_11:52:33.648430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:35.275160 run osmo-stp_10.42.42.5(pid=18251): stderr: | [0;m[38;5;43m20221214115233840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115233840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115233841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115233841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115233842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115233842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115233842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:35.416141 run osmo-stp_10.42.42.5(pid=18251): stdout: | (launched: 2022-12-14_11:52:33.648430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:35.551113 run osmo-stp_10.42.42.5(pid=18251): stderr: | [0;m[38;5;43m20221214115233840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115233840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115233841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115233841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115233842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115233842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115233842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:35.710947 run patchelf(pid=18254): Terminating (SIGINT) 11:52:35.896307 run patchelf(pid=18254): Terminated: ok {rc=0} 11:52:36.029652 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18251): Process ended prematurely: osmo-stp_10.42.42.5(pid=18251) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18251)] [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 11:52:36.040152 tst iperf3.py:8: Test FAILED (7.7 sec) 11:52:36.069105 run osmo-hlr_10.42.42.2(pid=18248): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18248)] 11:52:36.119684 run osmo-hlr_10.42.42.2(pid=18248): stdout: | (launched: 2022-12-14_11:52:32.672320) 11:52:36.172430 run osmo-hlr_10.42.42.2(pid=18248): stderr: | [0;m[1;31m20221214115232848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115232848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115232848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115232848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115232848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115232848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115232860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115232869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115232869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115232869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:36.225192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18243): Terminating (SIGTERM) 11:52:36.267370 run iperf3-srv_10.42.42.10(pid=18244): Terminating (SIGTERM) 11:52:36.309530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18247): Terminating (SIGTERM) 11:52:36.351732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18250): Terminating (SIGTERM) 11:52:36.394011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18253): Terminating (SIGTERM) 11:52:36.436517 --- ParallelTerminationStrategy: PID 18243 died... 11:52:36.456902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18243): Terminated: ok {rc=0} 11:52:36.503527 --- ParallelTerminationStrategy: PID 18244 died... 11:52:36.523442 run iperf3-srv_10.42.42.10(pid=18244): Terminated {rc=256} 11:52:36.569970 --- ParallelTerminationStrategy: PID 18247 died... 11:52:36.590070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18247): Terminated: ok {rc=0} 11:52:36.636309 --- ParallelTerminationStrategy: PID 18250 died... 11:52:36.656313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18250): Terminated: ok {rc=0} 11:52:36.702613 --- ParallelTerminationStrategy: PID 18253 died... 11:52:36.722547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18253): Terminated: ok {rc=0} 11:52:36.810817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 11:52:37.962559 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:37.975175 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:52:38.029613 tst iperf3m4.py: using LAC 40709 11:52:38.163337 tst iperf3m4.py: using RAC 164 11:52:38.295707 tst iperf3m4.py: using CellId 40709 11:52:38.424785 tst iperf3m4.py: using BVCI 40710 11:52:38.544015 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:38.555865 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:38.567436 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:38.579394 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:38.591032 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:38.602610 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:38.614342 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:38.625846 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:38.637594 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:52:38.756197 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:52:38.879706 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:52:39.001346 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:52:39.118738 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:52:39.325727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:39.636535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18255): Launched 11:52:39.906678 run iperf3-srv_10.42.42.10(pid=18256): Launched 11:52:40.023963 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:52:40.229584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:40.539598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18257): Launched 11:52:40.808337 run iperf3-srv_10.42.42.10(pid=18258): Launched 11:52:40.923569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:52:41.129785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:41.439206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18259): Launched 11:52:41.707337 run iperf3-srv_10.42.42.10(pid=18260): Launched 11:52:41.822413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:52:42.027503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:42.336942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18261): Launched 11:52:42.605226 run iperf3-srv_10.42.42.10(pid=18262): Launched 11:52:42.721165 tst iperf3m4.py:8: start network... 11:52:42.925517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:43.399155 run create_hlr_db(pid=18263): Launched 11:52:43.516561 bus /gobi_6: Setting Powered False 11:52:44.577935 run create_hlr_db(pid=18263): Terminated: ok {rc=0} 11:52:45.005509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18265): Launched 11:52:45.314338 run osmo-hlr_10.42.42.2(pid=18266): Launched 11:52:45.430564 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:45.984508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18268): Launched 11:52:46.339562 run osmo-stp_10.42.42.5(pid=18269): Launched 11:52:46.622261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:47.208638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18271): Launched 11:52:47.343174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:47.622584 run patchelf(pid=18272): Launched 11:52:47.806498 run osmo-stp_10.42.42.5(pid=18269): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18269)] 11:52:47.946091 run osmo-stp_10.42.42.5(pid=18269): stdout: | (launched: 2022-12-14_11:52:46.277930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:48.087125 run osmo-stp_10.42.42.5(pid=18269): stderr: | [0;m[38;5;43m20221214115246509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115246509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115246509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115246510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115246510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115246510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115246511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:48.228921 run osmo-stp_10.42.42.5(pid=18269): stdout: | (launched: 2022-12-14_11:52:46.277930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:48.363663 run osmo-stp_10.42.42.5(pid=18269): stderr: | [0;m[38;5;43m20221214115246509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115246509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115246509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115246510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115246510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115246510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115246511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:48.523530 run patchelf(pid=18272): Terminating (SIGINT) 11:52:48.708870 run patchelf(pid=18272): Terminated: ok {rc=0} 11:52:48.842044 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18269): Process ended prematurely: osmo-stp_10.42.42.5(pid=18269) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18269)] [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 11:52:48.852456 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:52:48.881400 run osmo-hlr_10.42.42.2(pid=18266): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18266)] 11:52:48.931729 run osmo-hlr_10.42.42.2(pid=18266): stdout: | (launched: 2022-12-14_11:52:45.257117) 11:52:48.983558 run osmo-hlr_10.42.42.2(pid=18266): stderr: | [0;m[1;31m20221214115245430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115245430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115245431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115245431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115245431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115245431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115245444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115245452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115245452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115245452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:49.035787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18255): Terminating (SIGTERM) 11:52:49.077951 run iperf3-srv_10.42.42.10(pid=18256): Terminating (SIGTERM) 11:52:49.122550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18257): Terminating (SIGTERM) 11:52:49.165083 run iperf3-srv_10.42.42.10(pid=18258): Terminating (SIGTERM) 11:52:49.206607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18259): Terminating (SIGTERM) 11:52:49.248271 run iperf3-srv_10.42.42.10(pid=18260): Terminating (SIGTERM) 11:52:49.289706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18261): Terminating (SIGTERM) 11:52:49.331290 run iperf3-srv_10.42.42.10(pid=18262): Terminating (SIGTERM) 11:52:49.372651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18265): Terminating (SIGTERM) 11:52:49.414247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18268): Terminating (SIGTERM) 11:52:49.455788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18271): Terminating (SIGTERM) 11:52:49.497630 --- ParallelTerminationStrategy: PID 18255 died... 11:52:49.517320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18255): Terminated: ok {rc=0} 11:52:49.563372 --- ParallelTerminationStrategy: PID 18256 died... 11:52:49.583195 run iperf3-srv_10.42.42.10(pid=18256): Terminated {rc=256} 11:52:49.628839 --- ParallelTerminationStrategy: PID 18257 died... 11:52:49.648789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18257): Terminated: ok {rc=0} 11:52:49.694818 --- ParallelTerminationStrategy: PID 18258 died... 11:52:49.714847 run iperf3-srv_10.42.42.10(pid=18258): Terminated {rc=256} 11:52:49.760795 --- ParallelTerminationStrategy: PID 18259 died... 11:52:49.780839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18259): Terminated: ok {rc=0} 11:52:49.827001 --- ParallelTerminationStrategy: PID 18260 died... 11:52:49.846598 run iperf3-srv_10.42.42.10(pid=18260): Terminated {rc=256} 11:52:49.892427 --- ParallelTerminationStrategy: PID 18261 died... 11:52:49.911933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18261): Terminated: ok {rc=0} 11:52:49.957696 --- ParallelTerminationStrategy: PID 18262 died... 11:52:49.977251 run iperf3-srv_10.42.42.10(pid=18262): Terminated {rc=256} 11:52:50.023067 --- ParallelTerminationStrategy: PID 18265 died... 11:52:50.042723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18265): Terminated: ok {rc=0} 11:52:50.088874 --- ParallelTerminationStrategy: PID 18268 died... 11:52:50.108607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18268): Terminated: ok {rc=0} 11:52:50.154481 --- ParallelTerminationStrategy: PID 18271 died... 11:52:50.174383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18271): Terminated: ok {rc=0} 11:52:50.261598 bus /gobi_4: Setting Powered False 11:52:51.361405 bus /gobi_4: Setting Powered False 11:52:52.478027 bus /gobi_1: Setting Powered False 11:52:53.577312 bus /gobi_1: Setting Powered False 11:52:54.693402 bus /gobi_0: Setting Powered False 11:52:55.791197 bus /gobi_0: Setting Powered False 11:52:56.907898 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 11:52:58.010984 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:58.023517 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:52:58.077450 tst ping.py: using LAC 40710 11:52:58.196602 tst ping.py: using RAC 165 11:52:58.314310 tst ping.py: using CellId 40710 11:52:58.434008 tst ping.py: using BVCI 40711 11:52:58.544849 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:58.556386 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:58.567721 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:58.578848 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:58.590902 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:58.602530 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:58.614284 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:52:58.625934 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:52:58.746847 tst ping.py:19: start network... 11:52:58.964632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:59.466224 run create_hlr_db(pid=18274): Launched 11:52:59.598794 bus /gobi_6: Setting Powered False 11:53:00.662424 run create_hlr_db(pid=18274): Terminated: ok {rc=0} 11:53:01.120477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18276): Launched 11:53:01.453348 run osmo-hlr_10.42.42.2(pid=18277): Launched 11:53:01.707446 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:02.357432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18279): Launched 11:53:02.687391 run osmo-stp_10.42.42.5(pid=18280): Launched 11:53:02.808676 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:53:03.366775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18282): Launched 11:53:03.489789 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:53:03.763003 run patchelf(pid=18283): Launched 11:53:03.943625 run osmo-stp_10.42.42.5(pid=18280): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18280)] 11:53:04.080443 run osmo-stp_10.42.42.5(pid=18280): stdout: | (launched: 2022-12-14_11:53:02.627223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:04.219759 run osmo-stp_10.42.42.5(pid=18280): stderr: | [0;m[38;5;43m20221214115302818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115302818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115302818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115302819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115302819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115302819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115302820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:04.358718 run osmo-stp_10.42.42.5(pid=18280): stdout: | (launched: 2022-12-14_11:53:02.627223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:04.490712 run osmo-stp_10.42.42.5(pid=18280): stderr: | [0;m[38;5;43m20221214115302818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115302818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115302818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115302819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115302819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115302819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115302820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:04.646865 run patchelf(pid=18283): Terminating (SIGINT) 11:53:04.828003 run patchelf(pid=18283): Terminated: ok {rc=0} 11:53:04.958480 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18280): Process ended prematurely: osmo-stp_10.42.42.5(pid=18280) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18280)] [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 11:53:04.968021 tst ping.py:22: Test FAILED (6.9 sec) 11:53:04.996288 run osmo-hlr_10.42.42.2(pid=18277): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18277)] 11:53:05.046641 run osmo-hlr_10.42.42.2(pid=18277): stdout: | (launched: 2022-12-14_11:53:01.395840) 11:53:05.098889 run osmo-hlr_10.42.42.2(pid=18277): stderr: | [0;m[1;31m20221214115301607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115301607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115301607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115301607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115301607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115301607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115301624 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115301639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115301639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115301639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:05.151085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18276): Terminating (SIGTERM) 11:53:05.193283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18279): Terminating (SIGTERM) 11:53:05.236144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18282): Terminating (SIGTERM) 11:53:05.278711 --- ParallelTerminationStrategy: PID 18276 died... 11:53:05.299069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18276): Terminated: ok {rc=0} 11:53:05.345512 --- ParallelTerminationStrategy: PID 18279 died... 11:53:05.365211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18279): Terminated: ok {rc=0} 11:53:05.411622 --- ParallelTerminationStrategy: PID 18282 died... 11:53:05.431334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18282): Terminated: ok {rc=0} 11:53:05.519728 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 11:53:06.608300 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:53:06.624175 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:53:06.676899 tst ping_idle_ping.py: using LAC 40711 11:53:06.803501 tst ping_idle_ping.py: using RAC 166 11:53:06.931232 tst ping_idle_ping.py: using CellId 40711 11:53:07.058134 tst ping_idle_ping.py: using BVCI 40712 11:53:07.177216 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:53:07.189085 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:53:07.200715 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:53:07.212369 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:53:07.224071 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:53:07.235642 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:53:07.247554 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:53:07.259290 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:53:07.376614 tst ping_idle_ping.py:24: start network... 11:53:07.580539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:08.050007 run create_hlr_db(pid=18285): Launched 11:53:08.168016 bus /gobi_6: Setting Powered False 11:53:09.228585 run create_hlr_db(pid=18285): Terminated: ok {rc=0} 11:53:09.673826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18287): Launched 11:53:09.998441 run osmo-hlr_10.42.42.2(pid=18288): Launched 11:53:10.122913 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:10.680619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18290): Launched 11:53:11.003809 run osmo-stp_10.42.42.5(pid=18291): Launched 11:53:11.126507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:53:11.684921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18293): Launched 11:53:11.809629 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:53:12.083341 run patchelf(pid=18294): Launched 11:53:12.264363 run osmo-stp_10.42.42.5(pid=18291): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18291)] 11:53:12.401292 run osmo-stp_10.42.42.5(pid=18291): stdout: | (launched: 2022-12-14_11:53:10.944130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:12.540018 run osmo-stp_10.42.42.5(pid=18291): stderr: | [0;m[38;5;43m20221214115311132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115311132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115311132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115311133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115311133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115311133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115311133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:12.679054 run osmo-stp_10.42.42.5(pid=18291): stdout: | (launched: 2022-12-14_11:53:10.944130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:12.811634 run osmo-stp_10.42.42.5(pid=18291): stderr: | [0;m[38;5;43m20221214115311132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115311132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115311132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115311133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115311133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115311133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115311133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:12.968164 run patchelf(pid=18294): Terminating (SIGINT) 11:53:13.149590 run patchelf(pid=18294): Terminated: ok {rc=0} 11:53:13.280618 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18291): Process ended prematurely: osmo-stp_10.42.42.5(pid=18291) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18291)] [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 11:53:13.290608 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:53:13.319098 run osmo-hlr_10.42.42.2(pid=18288): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18288)] 11:53:13.369774 run osmo-hlr_10.42.42.2(pid=18288): stdout: | (launched: 2022-12-14_11:53:09.938721) 11:53:13.422404 run osmo-hlr_10.42.42.2(pid=18288): stderr: | [0;m[1;31m20221214115310133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115310133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115310133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115310133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115310133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115310133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115310149 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115310157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115310157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115310157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:13.475113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18287): Terminating (SIGTERM) 11:53:13.517617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18290): Terminating (SIGTERM) 11:53:13.560157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18293): Terminating (SIGTERM) 11:53:13.602773 --- ParallelTerminationStrategy: PID 18287 died... 11:53:13.622856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18287): Terminated: ok {rc=0} 11:53:13.669125 --- ParallelTerminationStrategy: PID 18290 died... 11:53:13.688550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18290): Terminated: ok {rc=0} 11:53:13.734647 --- ParallelTerminationStrategy: PID 18293 died... 11:53:13.754136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18293): Terminated: ok {rc=0} 11:53:13.841359 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:53:15.157349 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:15.164576 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:53:15.198733 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:53:15.234239 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:53:15.291481 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:53:15.326449 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:53:15.362101 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:53:15.947681 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:53:15.954357 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:15.966844 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:53:16.042618 tst switch_tch_pdch.py: using LAC 40712 11:53:16.193722 tst switch_tch_pdch.py: using RAC 167 11:53:16.343644 tst switch_tch_pdch.py: using CellId 40712 11:53:16.466190 tst switch_tch_pdch.py: using BVCI 40713 11:53:16.581803 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:16.594228 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:16.606541 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:16.618818 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:16.631823 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:16.644616 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:16.657809 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:16.670929 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:16.792525 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:16.913239 tst switch_tch_pdch.py:51: start network... 11:53:17.191190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:17.664739 run create_hlr_db(pid=18300): Launched 11:53:17.780837 bus /gobi_6: Setting Powered False 11:53:18.839835 run create_hlr_db(pid=18300): Terminated: ok {rc=0} 11:53:19.283546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18302): Launched 11:53:19.606839 run osmo-hlr_10.42.42.2(pid=18303): Launched 11:53:19.731125 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:20.291803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18305): Launched 11:53:20.617561 run osmo-stp_10.42.42.5(pid=18306): Launched 11:53:20.741142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:53:21.298245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18308): Launched 11:53:21.422929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:53:21.695491 run patchelf(pid=18309): Launched 11:53:21.875820 run osmo-stp_10.42.42.5(pid=18306): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18306)] 11:53:22.012153 run osmo-stp_10.42.42.5(pid=18306): stdout: | (launched: 2022-12-14_11:53:20.557564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:22.150686 run osmo-stp_10.42.42.5(pid=18306): stderr: | [0;m[38;5;43m20221214115320747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115320747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115320747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115320748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115320748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115320748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115320748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:22.289789 run osmo-stp_10.42.42.5(pid=18306): stdout: | (launched: 2022-12-14_11:53:20.557564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:22.421390 run osmo-stp_10.42.42.5(pid=18306): stderr: | [0;m[38;5;43m20221214115320747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115320747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115320747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115320748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115320748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115320748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115320748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:22.577672 run patchelf(pid=18309): Terminating (SIGINT) 11:53:22.757889 run patchelf(pid=18309): Terminated: ok {rc=0} 11:53:22.887663 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18306): Process ended prematurely: osmo-stp_10.42.42.5(pid=18306) [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18306)] [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:53:22.897222 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 11:53:22.925243 run osmo-hlr_10.42.42.2(pid=18303): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18303)] 11:53:22.975204 run osmo-hlr_10.42.42.2(pid=18303): stdout: | (launched: 2022-12-14_11:53:19.547242) 11:53:23.026773 run osmo-hlr_10.42.42.2(pid=18303): stderr: | [0;m[1;31m20221214115319742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115319742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115319742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115319742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115319742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115319742 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115319754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115319763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115319763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115319763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:23.078908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18302): Terminating (SIGTERM) 11:53:23.120583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18305): Terminating (SIGTERM) 11:53:23.162564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18308): Terminating (SIGTERM) 11:53:23.204930 --- ParallelTerminationStrategy: PID 18302 died... 11:53:23.224603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18302): Terminated: ok {rc=0} 11:53:23.270828 --- ParallelTerminationStrategy: PID 18305 died... 11:53:23.290449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18305): Terminated: ok {rc=0} 11:53:23.336468 --- ParallelTerminationStrategy: PID 18308 died... 11:53:23.356033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18308): Terminated: ok {rc=0} 11:53:23.445433 bus /gobi_0: Setting Powered False 11:53:24.545756 bus /gobi_0: Setting Powered False 11:53:25.662387 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:53:26.920007 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:26.926258 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:53:26.960023 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:53:26.995615 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:53:27.051783 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:53:27.085763 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:53:27.120477 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:53:27.675405 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:53:27.680584 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:27.692024 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:53:27.762553 tst switch_tch_pdch.py: using LAC 40713 11:53:27.891219 tst switch_tch_pdch.py: using RAC 168 11:53:28.017537 tst switch_tch_pdch.py: using CellId 40713 11:53:28.137297 tst switch_tch_pdch.py: using BVCI 40714 11:53:28.248093 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:28.259278 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:28.270251 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:28.281285 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:28.292552 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:28.303801 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:28.314915 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:28.326089 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:53:28.442158 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:53:28.557969 tst switch_tch_pdch.py:51: start network... 11:53:28.760891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:29.202490 run create_hlr_db(pid=18313): Launched 11:53:29.316805 bus /gobi_6: Setting Powered False 11:53:30.377186 run create_hlr_db(pid=18313): Terminated: ok {rc=0} 11:53:30.795028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18315): Launched 11:53:31.121656 run osmo-hlr_10.42.42.2(pid=18316): Launched 11:53:31.359106 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:31.971542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18318): Launched 11:53:32.287892 run osmo-stp_10.42.42.5(pid=18319): Launched 11:53:32.405426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:53:32.900931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18321): Launched 11:53:33.016147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:53:33.270687 run patchelf(pid=18322): Launched 11:53:33.437703 run osmo-stp_10.42.42.5(pid=18319): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18319)] 11:53:33.565943 run osmo-stp_10.42.42.5(pid=18319): stdout: | (launched: 2022-12-14_11:53:32.231923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:33.695735 run osmo-stp_10.42.42.5(pid=18319): stderr: | [0;m[38;5;43m20221214115332398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115332399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115332399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115332399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115332400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115332400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115332400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:33.825420 run osmo-stp_10.42.42.5(pid=18319): stdout: | (launched: 2022-12-14_11:53:32.231923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:33.948320 run osmo-stp_10.42.42.5(pid=18319): stderr: | [0;m[38;5;43m20221214115332398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115332399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115332399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115332399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115332400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115332400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115332400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:34.094130 run patchelf(pid=18322): Terminating (SIGINT) 11:53:34.263322 run patchelf(pid=18322): Terminated: ok {rc=0} 11:53:34.384537 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18319): Process ended prematurely: osmo-stp_10.42.42.5(pid=18319) [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18319)] [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:53:34.393643 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 11:53:34.420174 run osmo-hlr_10.42.42.2(pid=18316): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18316)] 11:53:34.468422 run osmo-hlr_10.42.42.2(pid=18316): stdout: | (launched: 2022-12-14_11:53:31.064655) 11:53:34.518310 run osmo-hlr_10.42.42.2(pid=18316): stderr: | [0;m[1;31m20221214115331275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115331275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115331275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115331275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115331275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115331275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115331299 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115331312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115331312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115331312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:34.568360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18315): Terminating (SIGTERM) 11:53:34.608455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18318): Terminating (SIGTERM) 11:53:34.648714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18321): Terminating (SIGTERM) 11:53:34.689082 --- ParallelTerminationStrategy: PID 18315 died... 11:53:34.708743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18315): Terminated: ok {rc=0} 11:53:34.753454 --- ParallelTerminationStrategy: PID 18318 died... 11:53:34.772566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18318): Terminated: ok {rc=0} 11:53:34.817403 --- ParallelTerminationStrategy: PID 18321 died... 11:53:34.836457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18321): Terminated: ok {rc=0} 11:53:34.923660 bus /gobi_0: Setting Powered False 11:53:36.023235 bus /gobi_0: Setting Powered False 11:53:37.139844 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 11:53:38.403705 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:38.408360 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:53:38.442704 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 11:53:38.450129 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:53:38.500837 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:53:38.535742 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 11:53:38.542702 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:53:39.084068 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 11:53:39.089229 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 11:53:39.100420 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:53:39.149091 tst mo_mt_sms.py: using LAC 40714 11:53:39.273820 tst mo_mt_sms.py: using RAC 169 11:53:39.398195 tst mo_mt_sms.py: using CellId 40714 11:53:39.522394 tst mo_mt_sms.py: using BVCI 40715 11:53:39.639036 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:53:39.755548 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:53:39.873569 tst mo_mt_sms.py:9: start nitb and bts... 11:53:40.085517 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:53:40.699272 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18326): Launched 11:53:40.999971 run osmo-nitb_10.42.42.2(pid=18327): Launched 11:53:41.166699 run osmo-nitb_10.42.42.2(pid=18327): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18327)] 11:53:41.302938 run osmo-nitb_10.42.42.2(pid=18327): stdout: | (launched: 2022-12-14_11:53:40.944277) 11:53:41.440557 run osmo-nitb_10.42.42.2(pid=18327): stderr: | (launched: 2022-12-14_11:53:40.988607) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:53:41.578991 run osmo-nitb_10.42.42.2(pid=18327): stdout: | (launched: 2022-12-14_11:53:40.944277) 11:53:41.710403 run osmo-nitb_10.42.42.2(pid=18327): stderr: | (launched: 2022-12-14_11:53:40.988607) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18327) [trial-2404↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18327)] 11:53:42.113881 tst osmo-nitb_10.42.42.2(pid=18327): stdout: | (launched: 2022-12-14_11:53:40.944277) 11:53:42.234810 tst osmo-nitb_10.42.42.2(pid=18327): stderr: | (launched: 2022-12-14_11:53:40.988607) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:53:42.377808 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18327) [trial-2404↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18327)] [trial-2404↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 11:53:42.386442 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 11:53:42.393028 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18326): Terminating (SIGTERM) 11:53:42.602628 --- ParallelTerminationStrategy: PID 18326 died... 11:53:42.623763 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18326): Terminated: ok {rc=0} 11:53:42.712541 bus /sierra_3: Setting Powered False 11:53:43.815949 bus /sierra_3: Setting Powered False 11:53:44.935663 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 sms:trx-sysmocell5000 --------------------------------------------------------------------- 11:53:46.171298 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:46.176547 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:53:46.214981 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:53:46.244003 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:53:46.297464 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:53:46.332187 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:53:46.361094 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:53:46.926493 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 11:53:46.934666 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:53:46.947961 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:53:47.010020 tst mo_mt_sms.py: using LAC 40715 11:53:47.139234 tst mo_mt_sms.py: using RAC 170 11:53:47.265415 tst mo_mt_sms.py: using CellId 40715 11:53:47.384407 tst mo_mt_sms.py: using BVCI 40716 11:53:47.502787 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:53:47.514173 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:53:47.525655 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:53:47.536901 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:53:47.548392 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:53:47.563168 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:53:47.711394 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:53:47.832764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:48.334792 run create_hlr_db(pid=18333): Launched 11:53:48.465898 bus /sierra_2: Setting Powered False 11:53:49.530569 run create_hlr_db(pid=18333): Terminated: ok {rc=0} 11:53:49.983125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18335): Launched 11:53:50.308319 run osmo-hlr_10.42.42.2(pid=18336): Launched 11:53:50.431769 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:50.986259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18338): Launched 11:53:51.310685 run osmo-stp_10.42.42.5(pid=18339): Launched 11:53:51.434328 run osmo-msc_10.42.42.6: Starting osmo-msc 11:53:52.018260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18341): Launched 11:53:52.341628 run osmo-msc_10.42.42.6(pid=18342): Launched 11:53:52.522676 run osmo-stp_10.42.42.5(pid=18339): ERR: Terminated: ERROR {rc=1} [trial-2404↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18339)] 11:53:52.658425 run osmo-stp_10.42.42.5(pid=18339): stdout: | (launched: 2022-12-14_11:53:51.250703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:52.795585 run osmo-stp_10.42.42.5(pid=18339): stderr: | [0;m[38;5;43m20221214115351439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115351439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115351439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115351440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115351440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115351440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115351440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:52.930608 run osmo-stp_10.42.42.5(pid=18339): stdout: | (launched: 2022-12-14_11:53:51.250703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:53.059197 run osmo-stp_10.42.42.5(pid=18339): stderr: | [0;m[38;5;43m20221214115351439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115351439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115351439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115351440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115351440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115351440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115351440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:53.213415 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18339): Process ended prematurely: osmo-stp_10.42.42.5(pid=18339) [trial-2404↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18339)] [trial-2404↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 11:53:53.222355 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 11:53:53.249910 run osmo-hlr_10.42.42.2(pid=18336): ERR: Terminated: ERROR {rc=237} [trial-2404↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18336)] 11:53:53.300680 run osmo-hlr_10.42.42.2(pid=18336): stdout: | (launched: 2022-12-14_11:53:50.248472) 11:53:53.353147 run osmo-hlr_10.42.42.2(pid=18336): stderr: | [0;m[1;31m20221214115350445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115350445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115350445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115350445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115350445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115350445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115350458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115350466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115350466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115350466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:53.426065 run osmo-msc_10.42.42.6(pid=18342): ERR: Terminated: ERROR {rc=2} [trial-2404↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18342)] 11:53:53.476241 run osmo-msc_10.42.42.6(pid=18342): stdout: | (launched: 2022-12-14_11:53:52.281993) 11:53:53.527999 run osmo-msc_10.42.42.6(pid=18342): stderr: | [0;m[38;5;43m20221214115352600 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115352600 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe20323ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115352600 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115352600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115352601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115352601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115352602 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115352603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115352603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115352603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:53:53.580509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18335): Terminating (SIGTERM) 11:53:53.622778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18338): Terminating (SIGTERM) 11:53:53.665745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18341): Terminating (SIGTERM) 11:53:53.708106 --- ParallelTerminationStrategy: PID 18335 died... 11:53:53.728492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18335): Terminated: ok {rc=0} 11:53:53.775100 --- ParallelTerminationStrategy: PID 18338 died... 11:53:53.794820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18338): Terminated: ok {rc=0} 11:53:53.840939 --- ParallelTerminationStrategy: PID 18341 died... 11:53:53.860686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18341): Terminated: ok {rc=0} 11:53:53.949703 bus /sierra_3: Setting Powered False 11:53:55.047591 bus /sierra_3: Setting Powered False 11:53:56.165560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 11:53:57.403196 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:57.407658 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:53:57.442232 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 11:53:57.449388 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 11:53:57.486071 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:53:57.520696 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 11:53:57.527709 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 11:53:58.047897 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 11:53:58.053044 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 11:53:58.064275 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:53:58.113153 tst assert_extension.py: using LAC 40716 11:53:58.231992 tst assert_extension.py: using RAC 171 11:53:58.350385 tst assert_extension.py: using CellId 40716 11:53:58.469393 tst assert_extension.py: using BVCI 40717 11:53:58.578154 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 11:53:58.698325 tst assert_extension.py:10: start nitb and bts... 11:53:58.916422 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:53:59.577588 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18347): Launched 11:53:59.902574 run osmo-nitb_10.42.42.2(pid=18348): Launched 11:54:00.082539 run osmo-nitb_10.42.42.2(pid=18348): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18348)] 11:54:00.227728 run osmo-nitb_10.42.42.2(pid=18348): stdout: | (launched: 2022-12-14_11:53:59.842129) 11:54:00.374671 run osmo-nitb_10.42.42.2(pid=18348): stderr: | (launched: 2022-12-14_11:53:59.890272) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:54:00.521093 run osmo-nitb_10.42.42.2(pid=18348): stdout: | (launched: 2022-12-14_11:53:59.842129) 11:54:00.661689 run osmo-nitb_10.42.42.2(pid=18348): stderr: | (launched: 2022-12-14_11:53:59.890272) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18348): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18348) [trial-2404↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18348)] 11:54:01.024620 tst osmo-nitb_10.42.42.2(pid=18348): stdout: | (launched: 2022-12-14_11:53:59.842129) 11:54:01.157542 tst osmo-nitb_10.42.42.2(pid=18348): stderr: | (launched: 2022-12-14_11:53:59.890272) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:54:01.316258 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18348): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18348) [trial-2404↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18348)] [trial-2404↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 11:54:01.326648 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:54:01.335101 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18347): Terminating (SIGTERM) 11:54:01.549283 --- ParallelTerminationStrategy: PID 18347 died... 11:54:01.569957 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18347): Terminated: ok {rc=0} 11:54:01.661639 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 11:54:02.887527 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:02.892480 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:54:02.939576 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:54:02.973420 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 11:54:03.017445 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:54:03.069729 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:54:03.110169 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 11:54:03.663467 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 11:54:03.670085 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:54:03.682543 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:54:03.753515 tst assert_extension.py: using LAC 40717 11:54:03.882437 tst assert_extension.py: using RAC 172 11:54:04.010386 tst assert_extension.py: using CellId 40717 11:54:04.138640 tst assert_extension.py: using BVCI 40718 11:54:04.259723 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:54:04.272015 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:54:04.284084 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:54:04.297078 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:54:04.309202 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:54:04.321600 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 11:54:04.446761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:04.960319 run create_hlr_db(pid=18622): Launched 11:54:05.127251 bus /sierra_2: Setting Powered False 11:54:06.191583 run create_hlr_db(pid=18622): Terminated: ok {rc=0} 11:54:06.654898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18626): Launched 11:54:06.971383 run osmo-hlr_10.42.42.2(pid=18627): Launched 11:54:07.218113 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:07.987122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18629): Launched 11:54:08.322201 run osmo-stp_10.42.42.5(pid=18630): Launched 11:54:08.562408 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:09.226676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18632): Launched 11:54:09.561731 run osmo-msc_10.42.42.6(pid=18633): Launched 11:54:09.914643 run osmo-stp_10.42.42.5(pid=18630): ERR: Terminated: ERROR {rc=1} [trial-2404↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18630)] 11:54:10.193936 run osmo-stp_10.42.42.5(pid=18630): stdout: | (launched: 2022-12-14_11:54:08.262976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:10.371968 run osmo-stp_10.42.42.5(pid=18630): stderr: | [0;m[38;5;43m20221214115408555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115408555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115408555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115408555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115408556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115408556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115408556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:10.508682 run osmo-stp_10.42.42.5(pid=18630): stdout: | (launched: 2022-12-14_11:54:08.262976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:10.638789 run osmo-stp_10.42.42.5(pid=18630): stderr: | [0;m[38;5;43m20221214115408555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115408555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115408555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115408555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115408556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115408556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115408556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:10.795032 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18630): Process ended prematurely: osmo-stp_10.42.42.5(pid=18630) [trial-2404↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18630)] [trial-2404↪ussd:trx-sysmocell5000↪assert_extension.py:17] 11:54:10.805339 tst assert_extension.py:17: Test FAILED (7.1 sec) 11:54:10.834248 run osmo-hlr_10.42.42.2(pid=18627): ERR: Terminated: ERROR {rc=237} [trial-2404↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18627)] 11:54:10.887182 run osmo-hlr_10.42.42.2(pid=18627): stdout: | (launched: 2022-12-14_11:54:06.914922) 11:54:10.941357 run osmo-hlr_10.42.42.2(pid=18627): stderr: | [0;m[1;31m20221214115407215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115407215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115407216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115407216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115407216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115407216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115407232 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115407242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115407242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115407242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:11.015674 run osmo-msc_10.42.42.6(pid=18633): ERR: Terminated: ERROR {rc=2} [trial-2404↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18633)] 11:54:11.067299 run osmo-msc_10.42.42.6(pid=18633): stdout: | (launched: 2022-12-14_11:54:09.502764) 11:54:11.122066 run osmo-msc_10.42.42.6(pid=18633): stderr: | [0;m[38;5;43m20221214115409996 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115409996 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f380e1c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115410001 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115410001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115410001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115410001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115410003 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115410004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115410004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115410004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:11.176538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18626): Terminating (SIGTERM) 11:54:11.220869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18629): Terminating (SIGTERM) 11:54:11.265193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18632): Terminating (SIGTERM) 11:54:11.312259 --- ParallelTerminationStrategy: PID 18626 died... 11:54:11.333458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18626): Terminated: ok {rc=0} 11:54:11.382516 --- ParallelTerminationStrategy: PID 18629 died... 11:54:11.403013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18629): Terminated: ok {rc=0} 11:54:11.450168 --- ParallelTerminationStrategy: PID 18632 died... 11:54:11.471019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18632): Terminated: ok {rc=0} 11:54:11.562891 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:54:12.782513 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:12.789898 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:54:12.825386 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:54:12.854137 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:54:12.910953 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:54:12.947806 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:54:12.976145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:54:13.525687 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:54:13.582512 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:13.595165 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:54:13.667871 tst mo_mt_call.py: using LAC 40718 11:54:13.798574 tst mo_mt_call.py: using RAC 173 11:54:13.929821 tst mo_mt_call.py: using CellId 40718 11:54:14.061267 tst mo_mt_call.py: using BVCI 40719 11:54:14.184008 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:14.196711 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:14.210025 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:14.222663 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:14.235354 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:14.247963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:54:14.374256 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:54:14.500344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:15.020049 run create_hlr_db(pid=18638): Launched 11:54:15.189555 bus /sierra_2: Setting Powered False 11:54:16.281344 run create_hlr_db(pid=18638): Terminated: ok {rc=0} 11:54:16.854018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18640): Launched 11:54:17.230417 run osmo-hlr_10.42.42.2(pid=18641): Launched 11:54:17.468658 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:18.121853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18643): Launched 11:54:18.461524 run osmo-stp_10.42.42.5(pid=18644): Launched 11:54:18.711844 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:19.396089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18646): Launched 11:54:19.742874 run osmo-msc_10.42.42.6(pid=18647): Launched 11:54:20.118682 run osmo-stp_10.42.42.5(pid=18644): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18644)] 11:54:20.397893 run osmo-stp_10.42.42.5(pid=18644): stdout: | (launched: 2022-12-14_11:54:18.401061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:20.565676 run osmo-stp_10.42.42.5(pid=18644): stderr: | [0;m[38;5;43m20221214115418705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115418705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115418706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115418706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115418707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115418707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115418707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:20.705916 run osmo-stp_10.42.42.5(pid=18644): stdout: | (launched: 2022-12-14_11:54:18.401061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:20.838543 run osmo-stp_10.42.42.5(pid=18644): stderr: | [0;m[38;5;43m20221214115418705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115418705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115418706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115418706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115418707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115418707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115418707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:20.999240 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18644): Process ended prematurely: osmo-stp_10.42.42.5(pid=18644) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18644)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:54:21.009926 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 11:54:21.038813 run osmo-hlr_10.42.42.2(pid=18641): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18641)] 11:54:21.091831 run osmo-hlr_10.42.42.2(pid=18641): stdout: | (launched: 2022-12-14_11:54:17.173213) 11:54:21.145535 run osmo-hlr_10.42.42.2(pid=18641): stderr: | [0;m[1;31m20221214115417510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115417510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115417510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115417510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115417510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115417510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115417527 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115417544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115417544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115417544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:21.220807 run osmo-msc_10.42.42.6(pid=18647): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18647)] 11:54:21.272642 run osmo-msc_10.42.42.6(pid=18647): stdout: | (launched: 2022-12-14_11:54:19.681418) 11:54:21.327850 run osmo-msc_10.42.42.6(pid=18647): stderr: | [0;m[38;5;43m20221214115420190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115420190 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04d5a22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115420190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115420190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115420191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115420191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115420193 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115420193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115420193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115420193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:21.382748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18640): Terminating (SIGTERM) 11:54:21.426052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18643): Terminating (SIGTERM) 11:54:21.471500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18646): Terminating (SIGTERM) 11:54:21.519571 --- ParallelTerminationStrategy: PID 18640 died... 11:54:21.541536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18640): Terminated: ok {rc=0} 11:54:21.591464 --- ParallelTerminationStrategy: PID 18643 died... 11:54:21.612573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18643): Terminated: ok {rc=0} 11:54:21.661170 --- ParallelTerminationStrategy: PID 18646 died... 11:54:21.682023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18646): Terminated: ok {rc=0} 11:54:21.776118 bus /sierra_3: Setting Powered False 11:54:22.881345 bus /sierra_3: Setting Powered False 11:54:24.006066 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:54:25.165105 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:25.178756 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:54:25.253516 tst mo_mt_call_osmux.py: using LAC 40719 11:54:25.386405 tst mo_mt_call_osmux.py: using RAC 174 11:54:25.517651 tst mo_mt_call_osmux.py: using CellId 40719 11:54:25.637979 tst mo_mt_call_osmux.py: using BVCI 40720 11:54:25.749955 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:25.761391 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:25.772614 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:25.783876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:25.795251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:25.806727 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:54:25.924554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:54:26.046369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:26.552748 run create_hlr_db(pid=18650): Launched 11:54:26.685991 bus /sierra_2: Setting Powered False 11:54:27.750769 run create_hlr_db(pid=18650): Terminated: ok {rc=0} 11:54:28.187456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18652): Launched 11:54:28.494161 run osmo-hlr_10.42.42.2(pid=18653): Launched 11:54:28.612802 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:29.150977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18655): Launched 11:54:29.457395 run osmo-stp_10.42.42.5(pid=18656): Launched 11:54:29.574386 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:30.130057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18658): Launched 11:54:30.436103 run osmo-msc_10.42.42.6(pid=18659): Launched 11:54:30.606976 run osmo-stp_10.42.42.5(pid=18656): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18656)] 11:54:30.736762 run osmo-stp_10.42.42.5(pid=18656): stdout: | (launched: 2022-12-14_11:54:29.400612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:30.867645 run osmo-stp_10.42.42.5(pid=18656): stderr: | [0;m[38;5;43m20221214115429569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115429569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115429570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115429570 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115429571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115429571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115429571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:30.998915 run osmo-stp_10.42.42.5(pid=18656): stdout: | (launched: 2022-12-14_11:54:29.400612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:31.123988 run osmo-stp_10.42.42.5(pid=18656): stderr: | [0;m[38;5;43m20221214115429569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115429569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115429570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115429570 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115429571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115429571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115429571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:31.273957 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18656): Process ended prematurely: osmo-stp_10.42.42.5(pid=18656) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18656)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:54:31.284172 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:54:31.312019 run osmo-hlr_10.42.42.2(pid=18653): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18653)] 11:54:31.364485 run osmo-hlr_10.42.42.2(pid=18653): stdout: | (launched: 2022-12-14_11:54:28.436612) 11:54:31.416849 run osmo-hlr_10.42.42.2(pid=18653): stderr: | [0;m[1;31m20221214115428610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115428610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115428610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115428610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115428611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115428611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115428629 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115428639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115428639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115428639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:31.490551 run osmo-msc_10.42.42.6(pid=18659): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18659)] 11:54:31.540253 run osmo-msc_10.42.42.6(pid=18659): stdout: | (launched: 2022-12-14_11:54:30.379545) 11:54:31.593744 run osmo-msc_10.42.42.6(pid=18659): stderr: | [0;m[38;5;43m20221214115430646 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115430647 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff433636c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115430647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115430647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115430647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115430647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115430649 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115430649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115430649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115430650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:31.645999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18652): Terminating (SIGTERM) 11:54:31.692117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18655): Terminating (SIGTERM) 11:54:31.739034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18658): Terminating (SIGTERM) 11:54:31.785736 --- ParallelTerminationStrategy: PID 18652 died... 11:54:31.806924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18652): Terminated: ok {rc=0} 11:54:31.856813 --- ParallelTerminationStrategy: PID 18655 died... 11:54:31.877785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18655): Terminated: ok {rc=0} 11:54:31.930163 --- ParallelTerminationStrategy: PID 18658 died... 11:54:31.950989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18658): Terminated: ok {rc=0} 11:54:32.042891 bus /sierra_3: Setting Powered False 11:54:33.145386 bus /sierra_3: Setting Powered False 11:54:34.261834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:54:35.522740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:35.531824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:54:35.566586 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:54:35.593807 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:54:35.645448 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:54:35.680456 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:54:35.708894 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:54:36.263036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:54:36.316194 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:36.328062 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:54:36.399716 tst mo_mt_call.py: using LAC 40720 11:54:36.525877 tst mo_mt_call.py: using RAC 175 11:54:36.651934 tst mo_mt_call.py: using CellId 40720 11:54:36.778079 tst mo_mt_call.py: using BVCI 40721 11:54:36.889562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:36.900747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:36.911945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:36.923206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:36.934991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:36.946367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:54:37.067337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:54:37.185651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:37.690287 run create_hlr_db(pid=18664): Launched 11:54:37.823079 bus /sierra_2: Setting Powered False 11:54:38.887546 run create_hlr_db(pid=18664): Terminated: ok {rc=0} 11:54:39.323610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18666): Launched 11:54:39.631372 run osmo-hlr_10.42.42.2(pid=18667): Launched 11:54:39.749088 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:40.285039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18669): Launched 11:54:40.612844 run osmo-stp_10.42.42.5(pid=18670): Launched 11:54:40.737755 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:41.333087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18672): Launched 11:54:41.659812 run osmo-msc_10.42.42.6(pid=18673): Launched 11:54:41.842385 run osmo-stp_10.42.42.5(pid=18670): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18670)] 11:54:41.980898 run osmo-stp_10.42.42.5(pid=18670): stdout: | (launched: 2022-12-14_11:54:40.552631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:42.119386 run osmo-stp_10.42.42.5(pid=18670): stderr: | [0;m[38;5;43m20221214115440745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115440745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115440745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115440746 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115440746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115440746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115440746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:42.256583 run osmo-stp_10.42.42.5(pid=18670): stdout: | (launched: 2022-12-14_11:54:40.552631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:42.386953 run osmo-stp_10.42.42.5(pid=18670): stderr: | [0;m[38;5;43m20221214115440745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115440745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115440745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115440746 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115440746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115440746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115440746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:42.542258 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18670): Process ended prematurely: osmo-stp_10.42.42.5(pid=18670) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18670)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:54:42.552271 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:54:42.580346 run osmo-hlr_10.42.42.2(pid=18667): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18667)] 11:54:42.630617 run osmo-hlr_10.42.42.2(pid=18667): stdout: | (launched: 2022-12-14_11:54:39.574391) 11:54:42.682643 run osmo-hlr_10.42.42.2(pid=18667): stderr: | [0;m[1;31m20221214115439748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115439748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115439748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115439748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115439748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115439748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115439760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115439768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115439769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115439769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:42.755361 run osmo-msc_10.42.42.6(pid=18673): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18673)] 11:54:42.805599 run osmo-msc_10.42.42.6(pid=18673): stdout: | (launched: 2022-12-14_11:54:41.599535) 11:54:42.857422 run osmo-msc_10.42.42.6(pid=18673): stderr: | [0;m[38;5;43m20221214115441920 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115441920 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc1409dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115441920 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115441920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115441920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115441920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115441922 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115441923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115441923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115441923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:42.909655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18666): Terminating (SIGTERM) 11:54:42.951574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18669): Terminating (SIGTERM) 11:54:42.994215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18672): Terminating (SIGTERM) 11:54:43.036422 --- ParallelTerminationStrategy: PID 18666 died... 11:54:43.056707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18666): Terminated: ok {rc=0} 11:54:43.103059 --- ParallelTerminationStrategy: PID 18669 died... 11:54:43.122865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18669): Terminated: ok {rc=0} 11:54:43.169109 --- ParallelTerminationStrategy: PID 18672 died... 11:54:43.188805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18672): Terminated: ok {rc=0} 11:54:43.277510 bus /sierra_3: Setting Powered False 11:54:44.376090 bus /sierra_3: Setting Powered False 11:54:45.492867 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:54:46.648646 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:46.662255 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:54:46.737618 tst mo_mt_call_osmux.py: using LAC 40721 11:54:46.866418 tst mo_mt_call_osmux.py: using RAC 176 11:54:46.998694 tst mo_mt_call_osmux.py: using CellId 40721 11:54:47.154924 tst mo_mt_call_osmux.py: using BVCI 40722 11:54:47.269958 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:47.281513 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:47.292714 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:47.303949 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:47.315721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:47.327565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:54:47.448941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:54:47.573984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:48.048920 run create_hlr_db(pid=18675): Launched 11:54:48.165496 bus /sierra_2: Setting Powered False 11:54:49.225832 run create_hlr_db(pid=18675): Terminated: ok {rc=0} 11:54:49.650380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18677): Launched 11:54:49.954539 run osmo-hlr_10.42.42.2(pid=18678): Launched 11:54:50.072461 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:50.607942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18680): Launched 11:54:50.913313 run osmo-stp_10.42.42.5(pid=18681): Launched 11:54:51.029764 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:51.583150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18683): Launched 11:54:51.888857 run osmo-msc_10.42.42.6(pid=18684): Launched 11:54:52.059605 run osmo-stp_10.42.42.5(pid=18681): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18681)] 11:54:52.190485 run osmo-stp_10.42.42.5(pid=18681): stdout: | (launched: 2022-12-14_11:54:50.856642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:52.320216 run osmo-stp_10.42.42.5(pid=18681): stderr: | [0;m[38;5;43m20221214115451026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115451026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115451026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115451026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115451027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115451027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115451027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:52.448285 run osmo-stp_10.42.42.5(pid=18681): stdout: | (launched: 2022-12-14_11:54:50.856642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:52.569755 run osmo-stp_10.42.42.5(pid=18681): stderr: | [0;m[38;5;43m20221214115451026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115451026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115451026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115451026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115451027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115451027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115451027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:52.715383 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18681): Process ended prematurely: osmo-stp_10.42.42.5(pid=18681) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18681)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:54:52.724558 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:54:52.750846 run osmo-hlr_10.42.42.2(pid=18678): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18678)] 11:54:52.799304 run osmo-hlr_10.42.42.2(pid=18678): stdout: | (launched: 2022-12-14_11:54:49.898159) 11:54:52.849246 run osmo-hlr_10.42.42.2(pid=18678): stderr: | [0;m[1;31m20221214115450073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115450073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115450073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115450073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115450073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115450073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115450091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115450101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115450101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115450101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:52.918832 run osmo-msc_10.42.42.6(pid=18684): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18684)] 11:54:52.966451 run osmo-msc_10.42.42.6(pid=18684): stdout: | (launched: 2022-12-14_11:54:51.832097) 11:54:53.015953 run osmo-msc_10.42.42.6(pid=18684): stderr: | [0;m[38;5;43m20221214115452101 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115452101 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe090eb1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115452101 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115452102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115452102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115452102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115452103 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115452104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115452104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115452104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:53.065621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18677): Terminating (SIGTERM) 11:54:53.105805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18680): Terminating (SIGTERM) 11:54:53.146116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18683): Terminating (SIGTERM) 11:54:53.186392 --- ParallelTerminationStrategy: PID 18677 died... 11:54:53.205924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18677): Terminated: ok {rc=0} 11:54:53.250193 --- ParallelTerminationStrategy: PID 18680 died... 11:54:53.269196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18680): Terminated: ok {rc=0} 11:54:53.313327 --- ParallelTerminationStrategy: PID 18683 died... 11:54:53.332074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18683): Terminated: ok {rc=0} 11:54:53.419313 bus /sierra_3: Setting Powered False 11:54:54.519191 bus /sierra_3: Setting Powered False 11:54:55.636138 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:54:56.893597 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:56.900662 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:54:56.934917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:54:56.962665 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:54:57.015360 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:54:57.049817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:54:57.077239 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:54:57.630227 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:54:57.682539 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:54:57.694450 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:54:57.765666 tst mo_mt_call.py: using LAC 40722 11:54:57.892795 tst mo_mt_call.py: using RAC 177 11:54:58.023492 tst mo_mt_call.py: using CellId 40722 11:54:58.151228 tst mo_mt_call.py: using BVCI 40723 11:54:58.263307 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:54:58.274628 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:54:58.286301 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:54:58.297858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:54:58.309513 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:54:58.321052 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:54:58.443508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:54:58.561570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:59.034885 run create_hlr_db(pid=18690): Launched 11:54:59.151141 bus /sierra_2: Setting Powered False 11:55:00.215809 run create_hlr_db(pid=18690): Terminated: ok {rc=0} 11:55:00.672292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18692): Launched 11:55:01.029829 run osmo-hlr_10.42.42.2(pid=18693): Launched 11:55:01.303713 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:01.927839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18698): Launched 11:55:02.270820 run osmo-stp_10.42.42.5(pid=18699): Launched 11:55:02.394958 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:02.986788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18701): Launched 11:55:03.317089 run osmo-msc_10.42.42.6(pid=18702): Launched 11:55:03.498082 run osmo-stp_10.42.42.5(pid=18699): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18699)] 11:55:03.635822 run osmo-stp_10.42.42.5(pid=18699): stdout: | (launched: 2022-12-14_11:55:02.210075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:03.774141 run osmo-stp_10.42.42.5(pid=18699): stderr: | [0;m[38;5;43m20221214115502401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115502401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115502401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115502401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115502402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115502402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115502402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:03.911065 run osmo-stp_10.42.42.5(pid=18699): stdout: | (launched: 2022-12-14_11:55:02.210075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:04.040737 run osmo-stp_10.42.42.5(pid=18699): stderr: | [0;m[38;5;43m20221214115502401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115502401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115502401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115502401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115502402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115502402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115502402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:04.196815 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18699): Process ended prematurely: osmo-stp_10.42.42.5(pid=18699) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18699)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:55:04.206659 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 11:55:04.234664 run osmo-hlr_10.42.42.2(pid=18693): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18693)] 11:55:04.285312 run osmo-hlr_10.42.42.2(pid=18693): stdout: | (launched: 2022-12-14_11:55:00.970247) 11:55:04.337473 run osmo-hlr_10.42.42.2(pid=18693): stderr: | [0;m[1;31m20221214115501211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115501211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115501211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115501211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115501212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115501212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115501231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115501239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115501239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115501239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:04.410290 run osmo-msc_10.42.42.6(pid=18702): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18702)] 11:55:04.460311 run osmo-msc_10.42.42.6(pid=18702): stdout: | (launched: 2022-12-14_11:55:03.256246) 11:55:04.512149 run osmo-msc_10.42.42.6(pid=18702): stderr: | [0;m[38;5;43m20221214115503576 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115503576 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f18c8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115503576 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115503576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115503577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115503577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115503579 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115503579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115503579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115503579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:04.564352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18692): Terminating (SIGTERM) 11:55:04.606285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18698): Terminating (SIGTERM) 11:55:04.648718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18701): Terminating (SIGTERM) 11:55:04.691572 --- ParallelTerminationStrategy: PID 18692 died... 11:55:04.711602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18692): Terminated: ok {rc=0} 11:55:04.757866 --- ParallelTerminationStrategy: PID 18698 died... 11:55:04.777371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18698): Terminated: ok {rc=0} 11:55:04.823245 --- ParallelTerminationStrategy: PID 18701 died... 11:55:04.842870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18701): Terminated: ok {rc=0} 11:55:04.931099 bus /sierra_3: Setting Powered False 11:55:06.030957 bus /sierra_3: Setting Powered False 11:55:07.149962 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:55:08.301428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:08.313968 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:55:08.386565 tst mo_mt_call_osmux.py: using LAC 40723 11:55:08.520725 tst mo_mt_call_osmux.py: using RAC 178 11:55:08.641685 tst mo_mt_call_osmux.py: using CellId 40723 11:55:08.759906 tst mo_mt_call_osmux.py: using BVCI 40724 11:55:08.871310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:08.882844 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:08.894213 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:08.905661 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:08.917721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:08.929698 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:55:09.052119 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:55:09.173146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:09.681691 run create_hlr_db(pid=18704): Launched 11:55:09.816069 bus /sierra_2: Setting Powered False 11:55:10.881343 run create_hlr_db(pid=18704): Terminated: ok {rc=0} 11:55:11.320483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18706): Launched 11:55:11.628906 run osmo-hlr_10.42.42.2(pid=18707): Launched 11:55:11.746828 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:12.286960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18709): Launched 11:55:12.592589 run osmo-stp_10.42.42.5(pid=18710): Launched 11:55:12.708281 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:13.263663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18712): Launched 11:55:13.570738 run osmo-msc_10.42.42.6(pid=18713): Launched 11:55:13.743666 run osmo-stp_10.42.42.5(pid=18710): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18710)] 11:55:13.874065 run osmo-stp_10.42.42.5(pid=18710): stdout: | (launched: 2022-12-14_11:55:12.536038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:14.003911 run osmo-stp_10.42.42.5(pid=18710): stderr: | [0;m[38;5;43m20221214115512705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115512706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115512706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115512706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115512707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115512707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115512707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:14.132145 run osmo-stp_10.42.42.5(pid=18710): stdout: | (launched: 2022-12-14_11:55:12.536038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:14.254383 run osmo-stp_10.42.42.5(pid=18710): stderr: | [0;m[38;5;43m20221214115512705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115512706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115512706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115512706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115512707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115512707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115512707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:14.400385 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18710): Process ended prematurely: osmo-stp_10.42.42.5(pid=18710) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18710)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:55:14.409727 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:55:14.436423 run osmo-hlr_10.42.42.2(pid=18707): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18707)] 11:55:14.485722 run osmo-hlr_10.42.42.2(pid=18707): stdout: | (launched: 2022-12-14_11:55:11.572080) 11:55:14.535847 run osmo-hlr_10.42.42.2(pid=18707): stderr: | [0;m[1;31m20221214115511749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115511749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115511749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115511749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115511749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115511749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115511760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115511769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115511769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115511769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:14.605874 run osmo-msc_10.42.42.6(pid=18713): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18713)] 11:55:14.653821 run osmo-msc_10.42.42.6(pid=18713): stdout: | (launched: 2022-12-14_11:55:13.513742) 11:55:14.703599 run osmo-msc_10.42.42.6(pid=18713): stderr: | [0;m[38;5;43m20221214115513779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115513779 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0508d7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115513780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115513780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115513780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115513780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115513782 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115513782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115513782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115513782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:14.753885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18706): Terminating (SIGTERM) 11:55:14.794327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18709): Terminating (SIGTERM) 11:55:14.834868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18712): Terminating (SIGTERM) 11:55:14.875445 --- ParallelTerminationStrategy: PID 18706 died... 11:55:14.895205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18706): Terminated: ok {rc=0} 11:55:14.939697 --- ParallelTerminationStrategy: PID 18709 died... 11:55:14.958645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18709): Terminated: ok {rc=0} 11:55:15.002884 --- ParallelTerminationStrategy: PID 18712 died... 11:55:15.022045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18712): Terminated: ok {rc=0} 11:55:15.106598 bus /sierra_3: Setting Powered False 11:55:16.219233 bus /sierra_3: Setting Powered False 11:55:17.345369 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:55:18.596161 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:55:18.602918 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:55:18.636355 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:55:18.664323 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:55:18.714933 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:55:18.748043 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:55:18.774825 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:55:19.332800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:55:19.382051 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:19.393426 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:55:19.461128 tst mo_mt_call.py: using LAC 40724 11:55:19.579316 tst mo_mt_call.py: using RAC 179 11:55:19.698218 tst mo_mt_call.py: using CellId 40724 11:55:19.816051 tst mo_mt_call.py: using BVCI 40725 11:55:19.926295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:19.938005 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:19.949249 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:19.960344 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:19.971983 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:19.983419 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:55:20.104409 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:55:20.222942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:20.696245 run create_hlr_db(pid=18718): Launched 11:55:20.812519 bus /sierra_2: Setting Powered False 11:55:21.872462 run create_hlr_db(pid=18718): Terminated: ok {rc=0} 11:55:22.300883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18720): Launched 11:55:22.608257 run osmo-hlr_10.42.42.2(pid=18721): Launched 11:55:22.724190 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:23.262706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18723): Launched 11:55:23.569674 run osmo-stp_10.42.42.5(pid=18724): Launched 11:55:23.686342 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:24.241855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18726): Launched 11:55:24.551888 run osmo-msc_10.42.42.6(pid=18727): Launched 11:55:24.722517 run osmo-stp_10.42.42.5(pid=18724): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18724)] 11:55:24.852450 run osmo-stp_10.42.42.5(pid=18724): stdout: | (launched: 2022-12-14_11:55:23.512766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:24.982503 run osmo-stp_10.42.42.5(pid=18724): stderr: | [0;m[38;5;43m20221214115523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115523682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115523682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115523683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115523683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115523683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:25.111167 run osmo-stp_10.42.42.5(pid=18724): stdout: | (launched: 2022-12-14_11:55:23.512766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:25.232895 run osmo-stp_10.42.42.5(pid=18724): stderr: | [0;m[38;5;43m20221214115523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115523681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115523682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115523682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115523683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115523683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115523683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:25.378494 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18724): Process ended prematurely: osmo-stp_10.42.42.5(pid=18724) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18724)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:55:25.387621 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:55:25.414096 run osmo-hlr_10.42.42.2(pid=18721): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18721)] 11:55:25.463215 run osmo-hlr_10.42.42.2(pid=18721): stdout: | (launched: 2022-12-14_11:55:22.550892) 11:55:25.513689 run osmo-hlr_10.42.42.2(pid=18721): stderr: | [0;m[1;31m20221214115522726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115522726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115522726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115522726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115522726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115522726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115522738 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115522746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115522746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115522746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:25.584192 run osmo-msc_10.42.42.6(pid=18727): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18727)] 11:55:25.632344 run osmo-msc_10.42.42.6(pid=18727): stdout: | (launched: 2022-12-14_11:55:24.495108) 11:55:25.682593 run osmo-msc_10.42.42.6(pid=18727): stderr: | [0;m[38;5;43m20221214115524762 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115524762 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd812127c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115524763 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115524763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115524763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115524763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115524765 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115524765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115524765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115524765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:25.733245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18720): Terminating (SIGTERM) 11:55:25.774153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18723): Terminating (SIGTERM) 11:55:25.815468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18726): Terminating (SIGTERM) 11:55:25.857110 --- ParallelTerminationStrategy: PID 18720 died... 11:55:25.876883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18720): Terminated: ok {rc=0} 11:55:25.922006 --- ParallelTerminationStrategy: PID 18723 died... 11:55:25.941363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18723): Terminated: ok {rc=0} 11:55:25.985817 --- ParallelTerminationStrategy: PID 18726 died... 11:55:26.005155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18726): Terminated: ok {rc=0} 11:55:26.092893 bus /sierra_3: Setting Powered False 11:55:27.193714 bus /sierra_3: Setting Powered False 11:55:28.310811 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:55:29.463545 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:29.476539 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:55:29.549898 tst mo_mt_call_osmux.py: using LAC 40725 11:55:29.678632 tst mo_mt_call_osmux.py: using RAC 180 11:55:29.806941 tst mo_mt_call_osmux.py: using CellId 40725 11:55:29.934244 tst mo_mt_call_osmux.py: using BVCI 40726 11:55:30.053637 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:30.065429 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:30.076901 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:30.088508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:30.100109 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:30.111637 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:55:30.227832 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:55:30.349640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:30.885453 run create_hlr_db(pid=18729): Launched 11:55:31.033094 bus /sierra_2: Setting Powered False 11:55:32.093232 run create_hlr_db(pid=18729): Terminated: ok {rc=0} 11:55:32.524903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18731): Launched 11:55:32.833604 run osmo-hlr_10.42.42.2(pid=18732): Launched 11:55:32.950357 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:33.481807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18734): Launched 11:55:33.788501 run osmo-stp_10.42.42.5(pid=18735): Launched 11:55:33.905987 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:34.462020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18737): Launched 11:55:34.768281 run osmo-msc_10.42.42.6(pid=18738): Launched 11:55:34.938790 run osmo-stp_10.42.42.5(pid=18735): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18735)] 11:55:35.068155 run osmo-stp_10.42.42.5(pid=18735): stdout: | (launched: 2022-12-14_11:55:33.731545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:35.198433 run osmo-stp_10.42.42.5(pid=18735): stderr: | [0;m[38;5;43m20221214115533902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115533902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115533902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115533903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115533903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115533903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115533903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:35.326187 run osmo-stp_10.42.42.5(pid=18735): stdout: | (launched: 2022-12-14_11:55:33.731545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:35.447770 run osmo-stp_10.42.42.5(pid=18735): stderr: | [0;m[38;5;43m20221214115533902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115533902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115533902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115533903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115533903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115533903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115533903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:35.593413 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18735): Process ended prematurely: osmo-stp_10.42.42.5(pid=18735) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18735)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:55:35.602612 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:55:35.629044 run osmo-hlr_10.42.42.2(pid=18732): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18732)] 11:55:35.678077 run osmo-hlr_10.42.42.2(pid=18732): stdout: | (launched: 2022-12-14_11:55:32.776785) 11:55:35.728017 run osmo-hlr_10.42.42.2(pid=18732): stderr: | [0;m[1;31m20221214115532953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115532953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115532953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115532953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115532953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115532953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115532966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115532975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115532975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115532975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:35.797754 run osmo-msc_10.42.42.6(pid=18738): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18738)] 11:55:35.845828 run osmo-msc_10.42.42.6(pid=18738): stdout: | (launched: 2022-12-14_11:55:34.711548) 11:55:35.895359 run osmo-msc_10.42.42.6(pid=18738): stderr: | [0;m[38;5;43m20221214115534980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115534981 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f258d2cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115534981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115534981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115534981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115534981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115534983 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115534983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115534984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115534984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:35.945658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18731): Terminating (SIGTERM) 11:55:35.986269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18734): Terminating (SIGTERM) 11:55:36.026691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18737): Terminating (SIGTERM) 11:55:36.067245 --- ParallelTerminationStrategy: PID 18731 died... 11:55:36.086915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18731): Terminated: ok {rc=0} 11:55:36.132109 --- ParallelTerminationStrategy: PID 18734 died... 11:55:36.151318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18734): Terminated: ok {rc=0} 11:55:36.195922 --- ParallelTerminationStrategy: PID 18737 died... 11:55:36.215132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18737): Terminated: ok {rc=0} 11:55:36.302832 bus /sierra_3: Setting Powered False 11:55:37.401785 bus /sierra_3: Setting Powered False 11:55:38.519151 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:55:39.774666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:55:39.782041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:55:39.816368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:55:39.844290 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:55:39.897007 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:55:39.931465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:55:39.958916 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:55:40.513151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:55:40.566754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:40.578595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:55:40.651220 tst mo_mt_call.py: using LAC 40726 11:55:40.779393 tst mo_mt_call.py: using RAC 181 11:55:40.909897 tst mo_mt_call.py: using CellId 40726 11:55:41.039361 tst mo_mt_call.py: using BVCI 40727 11:55:41.158105 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:41.169792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:41.181293 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:41.192666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:41.204687 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:41.216663 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:55:41.335831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:55:41.456909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:41.964717 run create_hlr_db(pid=18743): Launched 11:55:42.098119 bus /sierra_2: Setting Powered False 11:55:43.162470 run create_hlr_db(pid=18743): Terminated: ok {rc=0} 11:55:43.600522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18745): Launched 11:55:43.906525 run osmo-hlr_10.42.42.2(pid=18746): Launched 11:55:44.023471 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:44.565819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18748): Launched 11:55:44.870409 run osmo-stp_10.42.42.5(pid=18749): Launched 11:55:44.985773 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:45.537976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18751): Launched 11:55:45.849281 run osmo-msc_10.42.42.6(pid=18752): Launched 11:55:46.108126 run osmo-stp_10.42.42.5(pid=18749): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18749)] 11:55:46.463497 run osmo-stp_10.42.42.5(pid=18749): stdout: | (launched: 2022-12-14_11:55:44.813929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:46.613293 run osmo-stp_10.42.42.5(pid=18749): stderr: | [0;m[38;5;43m20221214115544983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115544983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115544984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115544984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115544985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115544985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115544985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:46.754102 run osmo-stp_10.42.42.5(pid=18749): stdout: | (launched: 2022-12-14_11:55:44.813929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:46.886914 run osmo-stp_10.42.42.5(pid=18749): stderr: | [0;m[38;5;43m20221214115544983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115544983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115544984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115544984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115544985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115544985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115544985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:47.049905 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18749): Process ended prematurely: osmo-stp_10.42.42.5(pid=18749) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18749)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:55:47.060071 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:55:47.088885 run osmo-hlr_10.42.42.2(pid=18746): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18746)] 11:55:47.141947 run osmo-hlr_10.42.42.2(pid=18746): stdout: | (launched: 2022-12-14_11:55:43.850117) 11:55:47.196913 run osmo-hlr_10.42.42.2(pid=18746): stderr: | [0;m[1;31m20221214115544025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115544025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115544025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115544025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115544025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115544025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115544037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115544047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115544048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115544048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:47.272214 run osmo-msc_10.42.42.6(pid=18752): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18752)] 11:55:47.325871 run osmo-msc_10.42.42.6(pid=18752): stdout: | (launched: 2022-12-14_11:55:45.788250) 11:55:47.378916 run osmo-msc_10.42.42.6(pid=18752): stderr: | [0;m[38;5;43m20221214115546200 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115546201 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1d4e9b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115546201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115546201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115546201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115546202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115546205 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115546207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115546207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115546207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:47.431322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18745): Terminating (SIGTERM) 11:55:47.473631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18748): Terminating (SIGTERM) 11:55:47.516379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18751): Terminating (SIGTERM) 11:55:47.558946 --- ParallelTerminationStrategy: PID 18745 died... 11:55:47.579335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18745): Terminated: ok {rc=0} 11:55:47.625863 --- ParallelTerminationStrategy: PID 18748 died... 11:55:47.645551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18748): Terminated: ok {rc=0} 11:55:47.692003 --- ParallelTerminationStrategy: PID 18751 died... 11:55:47.711767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18751): Terminated: ok {rc=0} 11:55:47.800790 bus /sierra_3: Setting Powered False 11:55:48.900910 bus /sierra_3: Setting Powered False 11:55:50.017831 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:55:51.167664 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:51.180100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:55:51.253131 tst mo_mt_call_osmux.py: using LAC 40727 11:55:51.381224 tst mo_mt_call_osmux.py: using RAC 182 11:55:51.510734 tst mo_mt_call_osmux.py: using CellId 40727 11:55:51.640140 tst mo_mt_call_osmux.py: using BVCI 40728 11:55:51.758863 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:51.770755 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:51.782336 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:51.793982 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:51.805642 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:51.817221 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:55:51.935084 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:55:52.057329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:52.564422 run create_hlr_db(pid=18754): Launched 11:55:52.696465 bus /sierra_2: Setting Powered False 11:55:53.756415 run create_hlr_db(pid=18754): Terminated: ok {rc=0} 11:55:54.212518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18756): Launched 11:55:54.541848 run osmo-hlr_10.42.42.2(pid=18757): Launched 11:55:54.667706 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:55.234265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18759): Launched 11:55:55.561693 run osmo-stp_10.42.42.5(pid=18760): Launched 11:55:55.687103 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:56.279382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18762): Launched 11:55:56.606130 run osmo-msc_10.42.42.6(pid=18763): Launched 11:55:56.788571 run osmo-stp_10.42.42.5(pid=18760): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18760)] 11:55:56.925330 run osmo-stp_10.42.42.5(pid=18760): stdout: | (launched: 2022-12-14_11:55:55.501583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:57.063058 run osmo-stp_10.42.42.5(pid=18760): stderr: | [0;m[38;5;43m20221214115555693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115555693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115555693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115555694 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115555694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115555694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115555694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:57.199550 run osmo-stp_10.42.42.5(pid=18760): stdout: | (launched: 2022-12-14_11:55:55.501583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:57.328851 run osmo-stp_10.42.42.5(pid=18760): stderr: | [0;m[38;5;43m20221214115555693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115555693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115555693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115555694 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115555694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115555694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115555694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:57.483783 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18760): Process ended prematurely: osmo-stp_10.42.42.5(pid=18760) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18760)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:55:57.493634 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:55:57.521251 run osmo-hlr_10.42.42.2(pid=18757): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18757)] 11:55:57.571330 run osmo-hlr_10.42.42.2(pid=18757): stdout: | (launched: 2022-12-14_11:55:54.481686) 11:55:57.623176 run osmo-hlr_10.42.42.2(pid=18757): stderr: | [0;m[1;31m20221214115554680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115554680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115554680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115554680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115554680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115554680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115554693 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115554702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115554702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115554702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:57.695603 run osmo-msc_10.42.42.6(pid=18763): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18763)] 11:55:57.745567 run osmo-msc_10.42.42.6(pid=18763): stdout: | (launched: 2022-12-14_11:55:56.545573) 11:55:57.797280 run osmo-msc_10.42.42.6(pid=18763): stderr: | [0;m[38;5;43m20221214115556866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115556866 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe973fc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115556866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115556866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115556866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115556867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115556868 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115556869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115556869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115556869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:57.849310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18756): Terminating (SIGTERM) 11:55:57.890747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18759): Terminating (SIGTERM) 11:55:57.932925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18762): Terminating (SIGTERM) 11:55:57.974864 --- ParallelTerminationStrategy: PID 18756 died... 11:55:57.994910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18756): Terminated: ok {rc=0} 11:55:58.041058 --- ParallelTerminationStrategy: PID 18759 died... 11:55:58.060497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18759): Terminated: ok {rc=0} 11:55:58.106404 --- ParallelTerminationStrategy: PID 18762 died... 11:55:58.125934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18762): Terminated: ok {rc=0} 11:55:58.213651 bus /sierra_3: Setting Powered False 11:55:59.312663 bus /sierra_3: Setting Powered False 11:56:00.429906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:56:01.710418 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:56:01.717901 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:56:01.754864 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:56:01.783700 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:56:01.839566 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:56:01.884938 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:56:01.921465 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:56:02.455676 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:56:02.509058 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:02.520999 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:56:02.597591 tst mo_mt_call.py: using LAC 40728 11:56:02.728522 tst mo_mt_call.py: using RAC 183 11:56:02.855694 tst mo_mt_call.py: using CellId 40728 11:56:02.982322 tst mo_mt_call.py: using BVCI 40729 11:56:03.102723 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:03.114564 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:03.126153 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:03.137717 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:03.149868 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:03.161989 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:56:03.281820 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:56:03.404536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:03.910275 run create_hlr_db(pid=18768): Launched 11:56:04.044520 bus /sierra_2: Setting Powered False 11:56:05.108815 run create_hlr_db(pid=18768): Terminated: ok {rc=0} 11:56:05.565462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18770): Launched 11:56:05.892104 run osmo-hlr_10.42.42.2(pid=18771): Launched 11:56:06.015766 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:06.582714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18773): Launched 11:56:06.909859 run osmo-stp_10.42.42.5(pid=18774): Launched 11:56:07.034989 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:07.626367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18776): Launched 11:56:07.953241 run osmo-msc_10.42.42.6(pid=18777): Launched 11:56:08.134108 run osmo-stp_10.42.42.5(pid=18774): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18774)] 11:56:08.271457 run osmo-stp_10.42.42.5(pid=18774): stdout: | (launched: 2022-12-14_11:56:06.849634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:08.409826 run osmo-stp_10.42.42.5(pid=18774): stderr: | [0;m[38;5;43m20221214115607041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115607041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115607042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115607042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115607042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115607043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115607043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:08.546143 run osmo-stp_10.42.42.5(pid=18774): stdout: | (launched: 2022-12-14_11:56:06.849634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:08.675696 run osmo-stp_10.42.42.5(pid=18774): stderr: | [0;m[38;5;43m20221214115607041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115607041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115607042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115607042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115607042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115607043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115607043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:08.831052 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18774): Process ended prematurely: osmo-stp_10.42.42.5(pid=18774) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18774)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:56:08.840611 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:56:08.868212 run osmo-hlr_10.42.42.2(pid=18771): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18771)] 11:56:08.918495 run osmo-hlr_10.42.42.2(pid=18771): stdout: | (launched: 2022-12-14_11:56:05.832114) 11:56:08.970276 run osmo-hlr_10.42.42.2(pid=18771): stderr: | [0;m[1;31m20221214115606031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115606031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115606031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115606031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115606031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115606031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115606044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115606052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115606053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115606053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:09.042345 run osmo-msc_10.42.42.6(pid=18777): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18777)] 11:56:09.092264 run osmo-msc_10.42.42.6(pid=18777): stdout: | (launched: 2022-12-14_11:56:07.892921) 11:56:09.144072 run osmo-msc_10.42.42.6(pid=18777): stderr: | [0;m[38;5;43m20221214115608212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115608212 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1f8f373c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115608212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115608212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115608212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115608213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115608214 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115608215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115608215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115608215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:09.196063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18770): Terminating (SIGTERM) 11:56:09.237420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18773): Terminating (SIGTERM) 11:56:09.279934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18776): Terminating (SIGTERM) 11:56:09.321985 --- ParallelTerminationStrategy: PID 18770 died... 11:56:09.341868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18770): Terminated: ok {rc=0} 11:56:09.387965 --- ParallelTerminationStrategy: PID 18773 died... 11:56:09.407304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18773): Terminated: ok {rc=0} 11:56:09.453226 --- ParallelTerminationStrategy: PID 18776 died... 11:56:09.472468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18776): Terminated: ok {rc=0} 11:56:09.561430 bus /sierra_3: Setting Powered False 11:56:10.661326 bus /sierra_3: Setting Powered False 11:56:11.779935 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:56:12.930253 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:12.942874 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:56:13.016906 tst mo_mt_call_osmux.py: using LAC 40729 11:56:13.146988 tst mo_mt_call_osmux.py: using RAC 184 11:56:13.274830 tst mo_mt_call_osmux.py: using CellId 40729 11:56:13.404530 tst mo_mt_call_osmux.py: using BVCI 40730 11:56:13.522573 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:13.534372 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:13.545938 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:13.557541 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:13.569510 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:13.581135 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:56:13.699112 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:56:13.820126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:14.329095 run create_hlr_db(pid=18779): Launched 11:56:14.462439 bus /sierra_2: Setting Powered False 11:56:15.526678 run create_hlr_db(pid=18779): Terminated: ok {rc=0} 11:56:15.978872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18781): Launched 11:56:16.304690 run osmo-hlr_10.42.42.2(pid=18782): Launched 11:56:16.543994 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:17.296677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18784): Launched 11:56:17.608855 run osmo-stp_10.42.42.5(pid=18785): Launched 11:56:17.726929 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:18.279688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18787): Launched 11:56:18.586272 run osmo-msc_10.42.42.6(pid=18788): Launched 11:56:18.756370 run osmo-stp_10.42.42.5(pid=18785): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18785)] 11:56:18.886307 run osmo-stp_10.42.42.5(pid=18785): stdout: | (launched: 2022-12-14_11:56:17.551907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:19.015694 run osmo-stp_10.42.42.5(pid=18785): stderr: | [0;m[38;5;43m20221214115617719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115617719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115617719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115617720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115617720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115617720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115617720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:19.143305 run osmo-stp_10.42.42.5(pid=18785): stdout: | (launched: 2022-12-14_11:56:17.551907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:19.264626 run osmo-stp_10.42.42.5(pid=18785): stderr: | [0;m[38;5;43m20221214115617719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115617719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115617719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115617720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115617720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115617720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115617720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:19.410676 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18785): Process ended prematurely: osmo-stp_10.42.42.5(pid=18785) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18785)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:56:19.419715 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:56:19.446203 run osmo-hlr_10.42.42.2(pid=18782): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18782)] 11:56:19.494589 run osmo-hlr_10.42.42.2(pid=18782): stdout: | (launched: 2022-12-14_11:56:16.247202) 11:56:19.544247 run osmo-hlr_10.42.42.2(pid=18782): stderr: | [0;m[1;31m20221214115616595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115616595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115616595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115616595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115616595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115616595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115616621 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115616652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115616652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115616652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:19.613500 run osmo-msc_10.42.42.6(pid=18788): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18788)] 11:56:19.661049 run osmo-msc_10.42.42.6(pid=18788): stdout: | (launched: 2022-12-14_11:56:18.529643) 11:56:19.710368 run osmo-msc_10.42.42.6(pid=18788): stderr: | [0;m[38;5;43m20221214115618797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115618797 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1fa88f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115618797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115618797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115618797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115618798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115618799 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115618800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115618800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115618800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:19.759907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18781): Terminating (SIGTERM) 11:56:19.800245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18784): Terminating (SIGTERM) 11:56:19.840382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18787): Terminating (SIGTERM) 11:56:19.880739 --- ParallelTerminationStrategy: PID 18781 died... 11:56:19.900195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18781): Terminated: ok {rc=0} 11:56:19.944493 --- ParallelTerminationStrategy: PID 18784 died... 11:56:19.963354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18784): Terminated: ok {rc=0} 11:56:20.007480 --- ParallelTerminationStrategy: PID 18787 died... 11:56:20.026333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18787): Terminated: ok {rc=0} 11:56:20.112286 bus /sierra_3: Setting Powered False 11:56:21.211937 bus /sierra_3: Setting Powered False 11:56:22.325276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:56:23.574792 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:56:23.580499 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:56:23.613796 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:56:23.641028 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:56:23.694006 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:56:23.727976 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:56:23.754861 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:56:24.307213 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:56:24.360824 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:24.372469 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:56:24.445509 tst mo_mt_call.py: using LAC 40730 11:56:24.575684 tst mo_mt_call.py: using RAC 185 11:56:24.705799 tst mo_mt_call.py: using CellId 40730 11:56:24.836541 tst mo_mt_call.py: using BVCI 40731 11:56:24.955557 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:24.967029 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:24.978459 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:24.989921 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:25.001347 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:25.012765 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:56:25.130590 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:56:25.253438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:25.761963 run create_hlr_db(pid=18793): Launched 11:56:25.893320 bus /sierra_2: Setting Powered False 11:56:26.957729 run create_hlr_db(pid=18793): Terminated: ok {rc=0} 11:56:27.397070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18795): Launched 11:56:27.704380 run osmo-hlr_10.42.42.2(pid=18796): Launched 11:56:27.820715 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:28.351226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18798): Launched 11:56:28.660831 run osmo-stp_10.42.42.5(pid=18799): Launched 11:56:28.776623 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:29.331731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18801): Launched 11:56:29.639616 run osmo-msc_10.42.42.6(pid=18802): Launched 11:56:29.811302 run osmo-stp_10.42.42.5(pid=18799): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18799)] 11:56:29.942344 run osmo-stp_10.42.42.5(pid=18799): stdout: | (launched: 2022-12-14_11:56:28.603903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:30.071962 run osmo-stp_10.42.42.5(pid=18799): stderr: | [0;m[38;5;43m20221214115628774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115628775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115628775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115628775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115628776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115628776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115628776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:30.200116 run osmo-stp_10.42.42.5(pid=18799): stdout: | (launched: 2022-12-14_11:56:28.603903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:30.322357 run osmo-stp_10.42.42.5(pid=18799): stderr: | [0;m[38;5;43m20221214115628774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115628775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115628775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115628775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115628776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115628776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115628776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:30.467918 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18799): Process ended prematurely: osmo-stp_10.42.42.5(pid=18799) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18799)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:56:30.476887 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:56:30.503281 run osmo-hlr_10.42.42.2(pid=18796): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18796)] 11:56:30.552286 run osmo-hlr_10.42.42.2(pid=18796): stdout: | (launched: 2022-12-14_11:56:27.647627) 11:56:30.602584 run osmo-hlr_10.42.42.2(pid=18796): stderr: | [0;m[1;31m20221214115627822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115627822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115627822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115627822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115627822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115627822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115627834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115627843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115627843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115627843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:30.672539 run osmo-msc_10.42.42.6(pid=18802): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18802)] 11:56:30.720331 run osmo-msc_10.42.42.6(pid=18802): stdout: | (launched: 2022-12-14_11:56:29.582871) 11:56:30.770066 run osmo-msc_10.42.42.6(pid=18802): stderr: | [0;m[38;5;43m20221214115629850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115629850 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd3097c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115629850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115629850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115629850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115629851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115629852 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115629853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115629853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115629853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:30.820332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18795): Terminating (SIGTERM) 11:56:30.861724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18798): Terminating (SIGTERM) 11:56:30.902607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18801): Terminating (SIGTERM) 11:56:30.943810 --- ParallelTerminationStrategy: PID 18795 died... 11:56:30.963347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18795): Terminated: ok {rc=0} 11:56:31.008768 --- ParallelTerminationStrategy: PID 18798 died... 11:56:31.028774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18798): Terminated: ok {rc=0} 11:56:31.075179 --- ParallelTerminationStrategy: PID 18801 died... 11:56:31.095633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18801): Terminated: ok {rc=0} 11:56:31.191898 bus /sierra_3: Setting Powered False 11:56:32.303547 bus /sierra_3: Setting Powered False 11:56:33.425681 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:56:34.570783 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:34.582865 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:56:34.655101 tst mo_mt_call_osmux.py: using LAC 40731 11:56:34.777358 tst mo_mt_call_osmux.py: using RAC 186 11:56:34.897574 tst mo_mt_call_osmux.py: using CellId 40731 11:56:35.026765 tst mo_mt_call_osmux.py: using BVCI 40732 11:56:35.147612 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:35.159314 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:35.170728 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:35.182139 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:35.193629 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:35.204929 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:56:35.322902 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:56:35.449288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:35.956671 run create_hlr_db(pid=18804): Launched 11:56:36.088231 bus /sierra_2: Setting Powered False 11:56:37.149148 run create_hlr_db(pid=18804): Terminated: ok {rc=0} 11:56:37.606834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18806): Launched 11:56:37.933717 run osmo-hlr_10.42.42.2(pid=18807): Launched 11:56:38.058653 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:38.619792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18809): Launched 11:56:38.947946 run osmo-stp_10.42.42.5(pid=18810): Launched 11:56:39.071614 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:39.662196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18812): Launched 11:56:39.989360 run osmo-msc_10.42.42.6(pid=18813): Launched 11:56:40.173254 run osmo-stp_10.42.42.5(pid=18810): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18810)] 11:56:40.312080 run osmo-stp_10.42.42.5(pid=18810): stdout: | (launched: 2022-12-14_11:56:38.887590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:40.451241 run osmo-stp_10.42.42.5(pid=18810): stderr: | [0;m[38;5;43m20221214115639080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115639081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115639081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115639081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115639082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115639082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115639082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:40.587822 run osmo-stp_10.42.42.5(pid=18810): stdout: | (launched: 2022-12-14_11:56:38.887590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:40.717321 run osmo-stp_10.42.42.5(pid=18810): stderr: | [0;m[38;5;43m20221214115639080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115639081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115639081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115639081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115639082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115639082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115639082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:40.872643 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18810): Process ended prematurely: osmo-stp_10.42.42.5(pid=18810) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18810)] [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:56:40.882577 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:56:40.910338 run osmo-hlr_10.42.42.2(pid=18807): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18807)] 11:56:40.961108 run osmo-hlr_10.42.42.2(pid=18807): stdout: | (launched: 2022-12-14_11:56:37.873338) 11:56:41.012838 run osmo-hlr_10.42.42.2(pid=18807): stderr: | [0;m[1;31m20221214115638073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115638073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115638073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115638073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115638073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115638073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115638086 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115638094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115638095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115638095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:41.085057 run osmo-msc_10.42.42.6(pid=18813): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18813)] 11:56:41.135052 run osmo-msc_10.42.42.6(pid=18813): stdout: | (launched: 2022-12-14_11:56:39.929173) 11:56:41.186701 run osmo-msc_10.42.42.6(pid=18813): stderr: | [0;m[38;5;43m20221214115640251 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115640251 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f342f023c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115640251 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115640251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115640251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115640252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115640253 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115640254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115640254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115640254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:41.239162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18806): Terminating (SIGTERM) 11:56:41.281273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18809): Terminating (SIGTERM) 11:56:41.323580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18812): Terminating (SIGTERM) 11:56:41.365901 --- ParallelTerminationStrategy: PID 18806 died... 11:56:41.386072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18806): Terminated: ok {rc=0} 11:56:41.432032 --- ParallelTerminationStrategy: PID 18809 died... 11:56:41.451573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18809): Terminated: ok {rc=0} 11:56:41.497443 --- ParallelTerminationStrategy: PID 18812 died... 11:56:41.516686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18812): Terminated: ok {rc=0} 11:56:41.604454 bus /sierra_3: Setting Powered False 11:56:42.702414 bus /sierra_3: Setting Powered False 11:56:43.817893 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 11:56:45.068379 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:56:45.072874 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:56:45.106248 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:56:45.133720 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 11:56:45.220011 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:56:45.254868 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:56:45.282567 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 11:56:45.884431 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2404 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 11:56:45.890036 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:45.905744 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:56:45.963631 tst emergency_mo_mt_call.py: using LAC 40732 11:56:46.089547 tst emergency_mo_mt_call.py: using RAC 187 11:56:46.218771 tst emergency_mo_mt_call.py: using CellId 40732 11:56:46.377144 tst emergency_mo_mt_call.py: using BVCI 40733 11:56:46.498186 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:46.510130 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:46.521986 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:46.533721 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:46.545397 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:46.557087 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:56:46.680095 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:56:46.803960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:47.347694 run create_hlr_db(pid=18818): Launched 11:56:47.477856 bus /sierra_2: Setting Powered False 11:56:48.541873 run create_hlr_db(pid=18818): Terminated: ok {rc=0} 11:56:48.971870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18820): Launched 11:56:49.272132 run osmo-hlr_10.42.42.2(pid=18821): Launched 11:56:49.390365 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:49.908839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18823): Launched 11:56:50.209238 run osmo-stp_10.42.42.5(pid=18824): Launched 11:56:50.333532 tst emergency_mo_mt_call.py: using MSISDN 8671 11:56:50.489344 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:51.029076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18826): Launched 11:56:51.329908 run osmo-msc_10.42.42.6(pid=18827): Launched 11:56:51.497582 run osmo-stp_10.42.42.5(pid=18824): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18824)] 11:56:51.625104 run osmo-stp_10.42.42.5(pid=18824): stdout: | (launched: 2022-12-14_11:56:50.153382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:51.752248 run osmo-stp_10.42.42.5(pid=18824): stderr: | [0;m[38;5;43m20221214115650321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115650322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115650322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115650322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115650323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115650323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115650323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:51.877331 run osmo-stp_10.42.42.5(pid=18824): stdout: | (launched: 2022-12-14_11:56:50.153382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:51.997384 run osmo-stp_10.42.42.5(pid=18824): stderr: | [0;m[38;5;43m20221214115650321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115650322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115650322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115650322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115650323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115650323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115650323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:52.142334 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18824): Process ended prematurely: osmo-stp_10.42.42.5(pid=18824) [trial-2404↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18824)] [trial-2404↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 11:56:52.150946 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 11:56:52.177203 run osmo-hlr_10.42.42.2(pid=18821): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18821)] 11:56:52.226253 run osmo-hlr_10.42.42.2(pid=18821): stdout: | (launched: 2022-12-14_11:56:49.216635) 11:56:52.276482 run osmo-hlr_10.42.42.2(pid=18821): stderr: | [0;m[1;31m20221214115649399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115649399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115649399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115649399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115649400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115649400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115649411 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115649420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115649420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115649420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:52.346376 run osmo-msc_10.42.42.6(pid=18827): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18827)] 11:56:52.394430 run osmo-msc_10.42.42.6(pid=18827): stdout: | (launched: 2022-12-14_11:56:51.274090) 11:56:52.444212 run osmo-msc_10.42.42.6(pid=18827): stderr: | [0;m[38;5;43m20221214115651539 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115651539 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb6ff47c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115651540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115651540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115651540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115651540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115651542 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115651542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115651542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115651543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:52.494310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18820): Terminating (SIGTERM) 11:56:52.534913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18823): Terminating (SIGTERM) 11:56:52.575283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18826): Terminating (SIGTERM) 11:56:52.615899 --- ParallelTerminationStrategy: PID 18820 died... 11:56:52.635644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18820): Terminated: ok {rc=0} 11:56:52.680285 --- ParallelTerminationStrategy: PID 18823 died... 11:56:52.699777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18823): Terminated: ok {rc=0} 11:56:52.744236 --- ParallelTerminationStrategy: PID 18826 died... 11:56:52.763497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18826): Terminated: ok {rc=0} 11:56:52.851120 bus /sierra_3: Setting Powered False 11:56:53.952007 bus /sierra_3: Setting Powered False 11:56:55.065227 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 11:56:56.150118 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:56.161823 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:56:56.214925 tst emergency_preemptive_call.py: using LAC 40733 11:56:56.330633 tst emergency_preemptive_call.py: using RAC 188 11:56:56.447602 tst emergency_preemptive_call.py: using CellId 40733 11:56:56.563413 tst emergency_preemptive_call.py: using BVCI 40734 11:56:56.671326 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:56.682341 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:56.693036 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:56.703610 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:56.715120 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:56:56.726728 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:56:56.849584 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:56:56.970868 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:56:57.089124 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:56:57.204775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:57.671415 run create_hlr_db(pid=18829): Launched 11:56:57.784741 bus /sierra_2: Setting Powered False 11:56:58.845350 run create_hlr_db(pid=18829): Terminated: ok {rc=0} 11:56:59.287315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18831): Launched 11:56:59.610652 run osmo-hlr_10.42.42.2(pid=18832): Launched 11:56:59.734755 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:00.293195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18834): Launched 11:57:00.615461 run osmo-stp_10.42.42.5(pid=18835): Launched 11:57:00.748766 tst emergency_preemptive_call.py: using MSISDN 8672 11:57:00.944515 run osmo-msc_10.42.42.6: Starting osmo-msc 11:57:01.540889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18837): Launched 11:57:01.871205 run osmo-msc_10.42.42.6(pid=18838): Launched 11:57:02.225689 run osmo-stp_10.42.42.5(pid=18835): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18835)] 11:57:02.371129 run osmo-stp_10.42.42.5(pid=18835): stdout: | (launched: 2022-12-14_11:57:00.555896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:02.507114 run osmo-stp_10.42.42.5(pid=18835): stderr: | [0;m[38;5;43m20221214115700747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115700747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115700748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115700748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115700749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115700749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115700749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:02.640875 run osmo-stp_10.42.42.5(pid=18835): stdout: | (launched: 2022-12-14_11:57:00.555896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:02.769052 run osmo-stp_10.42.42.5(pid=18835): stderr: | [0;m[38;5;43m20221214115700747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115700747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115700748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115700748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115700749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115700749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115700749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:02.921771 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18835): Process ended prematurely: osmo-stp_10.42.42.5(pid=18835) [trial-2404↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18835)] [trial-2404↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 11:57:02.931248 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 11:57:02.959223 run osmo-hlr_10.42.42.2(pid=18832): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18832)] 11:57:03.010354 run osmo-hlr_10.42.42.2(pid=18832): stdout: | (launched: 2022-12-14_11:56:59.550954) 11:57:03.062998 run osmo-hlr_10.42.42.2(pid=18832): stderr: | [0;m[1;31m20221214115659748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115659748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115659748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115659748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115659748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115659748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115659760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115659768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115659768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115659769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:03.136906 run osmo-msc_10.42.42.6(pid=18838): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18838)] 11:57:03.187426 run osmo-msc_10.42.42.6(pid=18838): stdout: | (launched: 2022-12-14_11:57:01.811321) 11:57:03.239793 run osmo-msc_10.42.42.6(pid=18838): stderr: | [0;m[38;5;43m20221214115702261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214115702261 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58d7819c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214115702261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214115702261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214115702261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214115702261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214115702263 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214115702264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214115702264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214115702264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:57:03.292614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18831): Terminating (SIGTERM) 11:57:03.334835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18834): Terminating (SIGTERM) 11:57:03.377234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18837): Terminating (SIGTERM) 11:57:03.420098 --- ParallelTerminationStrategy: PID 18831 died... 11:57:03.440803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18831): Terminated: ok {rc=0} 11:57:03.488064 --- ParallelTerminationStrategy: PID 18834 died... 11:57:03.508168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18834): Terminated: ok {rc=0} 11:57:03.554527 --- ParallelTerminationStrategy: PID 18837 died... 11:57:03.574349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18837): Terminated: ok {rc=0} 11:57:03.663111 bus /sierra_9: Setting Powered False 11:57:04.762723 bus /sierra_9: Setting Powered False 11:57:05.879309 bus /sierra_8: Setting Powered False 11:57:06.977886 bus /sierra_8: Setting Powered False 11:57:08.097627 bus /sierra_3: Setting Powered False 11:57:09.196600 bus /sierra_3: Setting Powered False 11:57:10.313542 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 11:57:11.602561 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:57:11.607417 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:57:11.641745 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 11:57:11.681715 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 11:57:11.770793 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:57:11.804791 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 11:57:11.843844 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 11:57:12.437999 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 11:57:12.490127 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:12.501183 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:57:12.549741 tst cs_paging_gprs_active.py: using LAC 40734 11:57:12.669393 tst cs_paging_gprs_active.py: using RAC 189 11:57:12.789348 tst cs_paging_gprs_active.py: using CellId 40734 11:57:12.911960 tst cs_paging_gprs_active.py: using BVCI 40735 11:57:13.024559 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:13.035582 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:13.046149 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:13.056690 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:13.067527 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:13.080684 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:13.093125 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:13.105234 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:13.116326 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:57:13.239711 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:57:13.358438 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:57:13.580355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:13.910531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18844): Launched 11:57:14.197345 run iperf3-srv_10.42.42.10(pid=18845): Launched 11:57:14.320060 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:57:14.541103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:14.871213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18846): Launched 11:57:15.157652 run iperf3-srv_10.42.42.10(pid=18847): Launched 11:57:15.280812 tst cs_paging_gprs_active.py:38: start network... 11:57:15.502629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:16.033682 run create_hlr_db(pid=18848): Launched 11:57:16.200888 bus /sierra_2: Setting Powered False 11:57:17.265187 run create_hlr_db(pid=18848): Terminated: ok {rc=0} 11:57:17.706807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18850): Launched 11:57:18.014512 run osmo-hlr_10.42.42.2(pid=18851): Launched 11:57:18.132934 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:18.671480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18853): Launched 11:57:18.979914 run osmo-stp_10.42.42.5(pid=18854): Launched 11:57:19.096465 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:19.625937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18856): Launched 11:57:19.745253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:20.005432 run patchelf(pid=18857): Launched 11:57:20.176648 run osmo-stp_10.42.42.5(pid=18854): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18854)] 11:57:20.306901 run osmo-stp_10.42.42.5(pid=18854): stdout: | (launched: 2022-12-14_11:57:18.923125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:20.439563 run osmo-stp_10.42.42.5(pid=18854): stderr: | [0;m[38;5;43m20221214115719093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115719093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115719093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115719094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115719094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115719094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115719094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:20.571798 run osmo-stp_10.42.42.5(pid=18854): stdout: | (launched: 2022-12-14_11:57:18.923125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:20.698073 run osmo-stp_10.42.42.5(pid=18854): stderr: | [0;m[38;5;43m20221214115719093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115719093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115719093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115719094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115719094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115719094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115719094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:20.847238 run patchelf(pid=18857): Terminating (SIGINT) 11:57:21.019958 run patchelf(pid=18857): Terminated: ok {rc=0} 11:57:21.144924 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18854): Process ended prematurely: osmo-stp_10.42.42.5(pid=18854) [trial-2404↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18854)] [trial-2404↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 11:57:21.154840 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:57:21.182142 run osmo-hlr_10.42.42.2(pid=18851): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18851)] 11:57:21.230682 run osmo-hlr_10.42.42.2(pid=18851): stdout: | (launched: 2022-12-14_11:57:17.957124) 11:57:21.280669 run osmo-hlr_10.42.42.2(pid=18851): stderr: | [0;m[1;31m20221214115718131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115718131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115718131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115718131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115718131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115718131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115718143 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115718152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115718152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115718152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:21.330722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18844): Terminating (SIGTERM) 11:57:21.371213 run iperf3-srv_10.42.42.10(pid=18845): Terminating (SIGTERM) 11:57:21.411518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18846): Terminating (SIGTERM) 11:57:21.451744 run iperf3-srv_10.42.42.10(pid=18847): Terminating (SIGTERM) 11:57:21.491949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18850): Terminating (SIGTERM) 11:57:21.532201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18853): Terminating (SIGTERM) 11:57:21.572239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18856): Terminating (SIGTERM) 11:57:21.612465 --- ParallelTerminationStrategy: PID 18844 died... 11:57:21.632197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18844): Terminated: ok {rc=0} 11:57:21.677480 --- ParallelTerminationStrategy: PID 18845 died... 11:57:21.696475 run iperf3-srv_10.42.42.10(pid=18845): Terminated {rc=256} 11:57:21.740811 --- ParallelTerminationStrategy: PID 18846 died... 11:57:21.760597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18846): Terminated: ok {rc=0} 11:57:21.805281 --- ParallelTerminationStrategy: PID 18847 died... 11:57:21.824318 run iperf3-srv_10.42.42.10(pid=18847): Terminated {rc=256} 11:57:21.869332 --- ParallelTerminationStrategy: PID 18850 died... 11:57:21.888510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18850): Terminated: ok {rc=0} 11:57:21.933169 --- ParallelTerminationStrategy: PID 18853 died... 11:57:21.952244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18853): Terminated: ok {rc=0} 11:57:21.996550 --- ParallelTerminationStrategy: PID 18856 died... 11:57:22.015775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18856): Terminated: ok {rc=0} 11:57:22.103140 bus /gobi_0: Setting Powered False 11:57:23.203632 bus /gobi_0: Setting Powered False 11:57:24.321309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 11:57:25.469553 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:25.480897 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:57:25.532807 tst iperf3.py: using LAC 40735 11:57:25.652349 tst iperf3.py: using RAC 190 11:57:25.773363 tst iperf3.py: using CellId 40735 11:57:25.892133 tst iperf3.py: using BVCI 40736 11:57:26.002447 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:26.013266 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:26.023806 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:26.034536 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:26.045457 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:26.056197 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:26.067237 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:26.077953 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:26.088834 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:57:26.211394 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:57:26.434090 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:26.764216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18859): Launched 11:57:27.051605 run iperf3-srv_10.42.42.10(pid=18860): Launched 11:57:27.174837 tst iperf3.py:8: start network... 11:57:27.396898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:27.906579 run create_hlr_db(pid=18861): Launched 11:57:28.040943 bus /gobi_6: Setting Powered False 11:57:29.105288 run create_hlr_db(pid=18861): Terminated: ok {rc=0} 11:57:29.546321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18863): Launched 11:57:29.853289 run osmo-hlr_10.42.42.2(pid=18864): Launched 11:57:29.969801 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:30.512243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18866): Launched 11:57:30.820105 run osmo-stp_10.42.42.5(pid=18867): Launched 11:57:31.080225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:31.725742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18869): Launched 11:57:31.856034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:32.129766 run patchelf(pid=18870): Launched 11:57:32.317304 run osmo-stp_10.42.42.5(pid=18867): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18867)] 11:57:32.457803 run osmo-stp_10.42.42.5(pid=18867): stdout: | (launched: 2022-12-14_11:57:30.763115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:32.599415 run osmo-stp_10.42.42.5(pid=18867): stderr: | [0;m[38;5;43m20221214115730968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115730968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115730969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115730969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115730970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115730970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115730970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:32.740082 run osmo-stp_10.42.42.5(pid=18867): stdout: | (launched: 2022-12-14_11:57:30.763115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:32.874691 run osmo-stp_10.42.42.5(pid=18867): stderr: | [0;m[38;5;43m20221214115730968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115730968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115730969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115730969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115730970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115730970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115730970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:33.033818 run patchelf(pid=18870): Terminating (SIGINT) 11:57:33.217376 run patchelf(pid=18870): Terminated: ok {rc=0} 11:57:33.350820 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18867): Process ended prematurely: osmo-stp_10.42.42.5(pid=18867) [trial-2404↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18867)] [trial-2404↪gprs:trx-sysmocell5000↪iperf3.py:8] 11:57:33.361797 tst iperf3.py:8: Test FAILED (7.9 sec) 11:57:33.390776 run osmo-hlr_10.42.42.2(pid=18864): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18864)] 11:57:33.441504 run osmo-hlr_10.42.42.2(pid=18864): stdout: | (launched: 2022-12-14_11:57:29.796320) 11:57:33.493996 run osmo-hlr_10.42.42.2(pid=18864): stderr: | [0;m[1;31m20221214115729972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115729972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115729972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115729972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115729972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115729972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115729984 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115729993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115729993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115729993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:33.546945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18859): Terminating (SIGTERM) 11:57:33.589551 run iperf3-srv_10.42.42.10(pid=18860): Terminating (SIGTERM) 11:57:33.632182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18863): Terminating (SIGTERM) 11:57:33.674642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18866): Terminating (SIGTERM) 11:57:33.716863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18869): Terminating (SIGTERM) 11:57:33.759354 --- ParallelTerminationStrategy: PID 18859 died... 11:57:33.779495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18859): Terminated: ok {rc=0} 11:57:33.826242 --- ParallelTerminationStrategy: PID 18860 died... 11:57:33.845855 run iperf3-srv_10.42.42.10(pid=18860): Terminated {rc=256} 11:57:33.892071 --- ParallelTerminationStrategy: PID 18863 died... 11:57:33.911910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18863): Terminated: ok {rc=0} 11:57:33.958403 --- ParallelTerminationStrategy: PID 18866 died... 11:57:33.978198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18866): Terminated: ok {rc=0} 11:57:34.024455 --- ParallelTerminationStrategy: PID 18869 died... 11:57:34.044159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18869): Terminated: ok {rc=0} 11:57:34.132121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 11:57:35.278166 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:35.289616 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:57:35.339150 tst iperf3m4.py: using LAC 40736 11:57:35.467827 tst iperf3m4.py: using RAC 191 11:57:35.587882 tst iperf3m4.py: using CellId 40736 11:57:35.718218 tst iperf3m4.py: using BVCI 40737 11:57:35.837906 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:35.849336 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:35.860361 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:35.871444 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:35.882699 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:35.893721 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:35.904869 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:35.915960 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:35.927186 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:57:36.047580 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:57:36.169235 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:57:36.289950 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:57:36.412036 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:57:36.632891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:36.961914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18871): Launched 11:57:37.248390 run iperf3-srv_10.42.42.10(pid=18872): Launched 11:57:37.372541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:57:37.593171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:37.921668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18873): Launched 11:57:38.207568 run iperf3-srv_10.42.42.10(pid=18874): Launched 11:57:38.330575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:57:38.550808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:38.880134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18875): Launched 11:57:39.167669 run iperf3-srv_10.42.42.10(pid=18876): Launched 11:57:39.291505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:57:39.513396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:39.843303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18877): Launched 11:57:40.129222 run iperf3-srv_10.42.42.10(pid=18878): Launched 11:57:40.253429 tst iperf3m4.py:8: start network... 11:57:40.474507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:40.982263 run create_hlr_db(pid=18879): Launched 11:57:41.116184 bus /gobi_6: Setting Powered False 11:57:42.181125 run create_hlr_db(pid=18879): Terminated: ok {rc=0} 11:57:42.619938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18881): Launched 11:57:42.927174 run osmo-hlr_10.42.42.2(pid=18882): Launched 11:57:43.043045 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:43.589421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18884): Launched 11:57:43.897435 run osmo-stp_10.42.42.5(pid=18885): Launched 11:57:44.013931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:44.541720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18887): Launched 11:57:44.659980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:44.918636 run patchelf(pid=18888): Launched 11:57:45.090306 run osmo-stp_10.42.42.5(pid=18885): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18885)] 11:57:45.220640 run osmo-stp_10.42.42.5(pid=18885): stdout: | (launched: 2022-12-14_11:57:43.840232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:45.352304 run osmo-stp_10.42.42.5(pid=18885): stderr: | [0;m[38;5;43m20221214115744013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115744013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115744013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115744013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115744014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115744014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115744014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:45.484530 run osmo-stp_10.42.42.5(pid=18885): stdout: | (launched: 2022-12-14_11:57:43.840232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:45.610400 run osmo-stp_10.42.42.5(pid=18885): stderr: | [0;m[38;5;43m20221214115744013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115744013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115744013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115744013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115744014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115744014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115744014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:45.759227 run patchelf(pid=18888): Terminating (SIGINT) 11:57:45.973863 run patchelf(pid=18888): Terminated: ok {rc=0} 11:57:46.112505 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18885): Process ended prematurely: osmo-stp_10.42.42.5(pid=18885) [trial-2404↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18885)] [trial-2404↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 11:57:46.123995 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:57:46.154739 run osmo-hlr_10.42.42.2(pid=18882): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18882)] 11:57:46.207202 run osmo-hlr_10.42.42.2(pid=18882): stdout: | (launched: 2022-12-14_11:57:42.870106) 11:57:46.261081 run osmo-hlr_10.42.42.2(pid=18882): stderr: | [0;m[1;31m20221214115743045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115743045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115743045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115743045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115743045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115743045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115743057 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115743066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115743066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115743066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:46.316891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18871): Terminating (SIGTERM) 11:57:46.361150 run iperf3-srv_10.42.42.10(pid=18872): Terminating (SIGTERM) 11:57:46.405731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18873): Terminating (SIGTERM) 11:57:46.450211 run iperf3-srv_10.42.42.10(pid=18874): Terminating (SIGTERM) 11:57:46.495186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18875): Terminating (SIGTERM) 11:57:46.540107 run iperf3-srv_10.42.42.10(pid=18876): Terminating (SIGTERM) 11:57:46.584440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18877): Terminating (SIGTERM) 11:57:46.628183 run iperf3-srv_10.42.42.10(pid=18878): Terminating (SIGTERM) 11:57:46.672229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18881): Terminating (SIGTERM) 11:57:46.717236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18884): Terminating (SIGTERM) 11:57:46.763088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18887): Terminating (SIGTERM) 11:57:46.809331 --- ParallelTerminationStrategy: PID 18871 died... 11:57:46.830855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18871): Terminated: ok {rc=0} 11:57:46.880478 --- ParallelTerminationStrategy: PID 18872 died... 11:57:46.901750 run iperf3-srv_10.42.42.10(pid=18872): Terminated {rc=256} 11:57:46.952090 --- ParallelTerminationStrategy: PID 18873 died... 11:57:46.973309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18873): Terminated: ok {rc=0} 11:57:47.021223 --- ParallelTerminationStrategy: PID 18874 died... 11:57:47.041846 run iperf3-srv_10.42.42.10(pid=18874): Terminated {rc=256} 11:57:47.090313 --- ParallelTerminationStrategy: PID 18875 died... 11:57:47.111331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18875): Terminated: ok {rc=0} 11:57:47.159014 --- ParallelTerminationStrategy: PID 18876 died... 11:57:47.179369 run iperf3-srv_10.42.42.10(pid=18876): Terminated {rc=256} 11:57:47.226199 --- ParallelTerminationStrategy: PID 18877 died... 11:57:47.246108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18877): Terminated: ok {rc=0} 11:57:47.292078 --- ParallelTerminationStrategy: PID 18878 died... 11:57:47.312049 run iperf3-srv_10.42.42.10(pid=18878): Terminated {rc=256} 11:57:47.358273 --- ParallelTerminationStrategy: PID 18881 died... 11:57:47.378163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18881): Terminated: ok {rc=0} 11:57:47.424739 --- ParallelTerminationStrategy: PID 18884 died... 11:57:47.445201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18884): Terminated: ok {rc=0} 11:57:47.491997 --- ParallelTerminationStrategy: PID 18887 died... 11:57:47.511885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18887): Terminated: ok {rc=0} 11:57:47.601506 bus /gobi_4: Setting Powered False 11:57:48.701407 bus /gobi_4: Setting Powered False 11:57:49.818087 bus /gobi_1: Setting Powered False 11:57:50.915655 bus /gobi_1: Setting Powered False 11:57:52.031093 bus /gobi_0: Setting Powered False 11:57:53.130019 bus /gobi_0: Setting Powered False 11:57:54.248302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 11:57:55.351737 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:55.363738 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:57:55.417091 tst ping.py: using LAC 40737 11:57:55.534118 tst ping.py: using RAC 192 11:57:55.650569 tst ping.py: using CellId 40737 11:57:55.768570 tst ping.py: using BVCI 40738 11:57:55.877959 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:55.888620 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:55.899332 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:55.910040 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:55.921452 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:55.932674 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:55.944186 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:57:55.955623 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:57:56.076047 tst ping.py:19: start network... 11:57:56.293928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:56.791013 run create_hlr_db(pid=18889): Launched 11:57:56.922943 bus /gobi_6: Setting Powered False 11:57:57.986549 run create_hlr_db(pid=18889): Terminated: ok {rc=0} 11:57:58.415517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18891): Launched 11:57:58.715157 run osmo-hlr_10.42.42.2(pid=18892): Launched 11:57:58.828550 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:59.358851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18894): Launched 11:57:59.659349 run osmo-stp_10.42.42.5(pid=18895): Launched 11:57:59.773004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:00.289789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18897): Launched 11:58:00.406295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:00.660026 run patchelf(pid=18898): Launched 11:58:00.826900 run osmo-stp_10.42.42.5(pid=18895): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18895)] 11:58:00.984477 run osmo-stp_10.42.42.5(pid=18895): stdout: | (launched: 2022-12-14_11:57:59.603320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:01.128090 run osmo-stp_10.42.42.5(pid=18895): stderr: | [0;m[38;5;43m20221214115759773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115759773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115759773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115759774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115759774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115759774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115759774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:01.270297 run osmo-stp_10.42.42.5(pid=18895): stdout: | (launched: 2022-12-14_11:57:59.603320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:01.407791 run osmo-stp_10.42.42.5(pid=18895): stderr: | [0;m[38;5;43m20221214115759773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115759773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115759773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115759774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115759774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115759774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115759774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:01.570266 run patchelf(pid=18898): Terminating (SIGINT) 11:58:01.756502 run patchelf(pid=18898): Terminated: ok {rc=0} 11:58:01.890326 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18895): Process ended prematurely: osmo-stp_10.42.42.5(pid=18895) [trial-2404↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18895)] [trial-2404↪gprs:trx-sysmocell5000↪ping.py:22] 11:58:01.900688 tst ping.py:22: Test FAILED (6.5 sec) 11:58:01.931197 run osmo-hlr_10.42.42.2(pid=18892): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18892)] 11:58:01.985525 run osmo-hlr_10.42.42.2(pid=18892): stdout: | (launched: 2022-12-14_11:57:58.659265) 11:58:02.040768 run osmo-hlr_10.42.42.2(pid=18892): stderr: | [0;m[1;31m20221214115758832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115758832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115758832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115758832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115758832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115758832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115758848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115758858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115758858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115758858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:02.096845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18891): Terminating (SIGTERM) 11:58:02.141814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18894): Terminating (SIGTERM) 11:58:02.187900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18897): Terminating (SIGTERM) 11:58:02.232176 --- ParallelTerminationStrategy: PID 18891 died... 11:58:02.253098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18891): Terminated: ok {rc=0} 11:58:02.300262 --- ParallelTerminationStrategy: PID 18894 died... 11:58:02.321156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18894): Terminated: ok {rc=0} 11:58:02.368897 --- ParallelTerminationStrategy: PID 18897 died... 11:58:02.389714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18897): Terminated: ok {rc=0} 11:58:02.479922 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 11:58:03.568363 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:58:03.580318 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:58:03.632363 tst ping_idle_ping.py: using LAC 40738 11:58:03.752183 tst ping_idle_ping.py: using RAC 193 11:58:03.869971 tst ping_idle_ping.py: using CellId 40738 11:58:03.991812 tst ping_idle_ping.py: using BVCI 40739 11:58:04.102081 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:58:04.113075 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:58:04.123623 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:58:04.134288 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:58:04.144912 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:58:04.155781 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:58:04.166833 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:58:04.177771 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:58:04.298028 tst ping_idle_ping.py:24: start network... 11:58:04.516865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:05.019758 run create_hlr_db(pid=18899): Launched 11:58:05.152803 bus /gobi_6: Setting Powered False 11:58:06.217653 run create_hlr_db(pid=18899): Terminated: ok {rc=0} 11:58:06.670427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18901): Launched 11:58:06.992736 run osmo-hlr_10.42.42.2(pid=18902): Launched 11:58:07.116534 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:07.678426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18904): Launched 11:58:08.002162 run osmo-stp_10.42.42.5(pid=18905): Launched 11:58:08.125528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:08.682387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18907): Launched 11:58:08.805346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:09.078516 run patchelf(pid=18908): Launched 11:58:09.257858 run osmo-stp_10.42.42.5(pid=18905): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18905)] 11:58:09.395014 run osmo-stp_10.42.42.5(pid=18905): stdout: | (launched: 2022-12-14_11:58:07.942133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:09.533259 run osmo-stp_10.42.42.5(pid=18905): stderr: | [0;m[38;5;43m20221214115808136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115808136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115808137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115808137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115808138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115808138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115808138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:09.671939 run osmo-stp_10.42.42.5(pid=18905): stdout: | (launched: 2022-12-14_11:58:07.942133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:09.803858 run osmo-stp_10.42.42.5(pid=18905): stderr: | [0;m[38;5;43m20221214115808136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115808136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115808137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115808137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115808138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115808138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115808138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:09.960035 run patchelf(pid=18908): Terminating (SIGINT) 11:58:10.140587 run patchelf(pid=18908): Terminated: ok {rc=0} 11:58:10.270782 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18905): Process ended prematurely: osmo-stp_10.42.42.5(pid=18905) [trial-2404↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18905)] [trial-2404↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 11:58:10.280346 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:58:10.308457 run osmo-hlr_10.42.42.2(pid=18902): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18902)] 11:58:10.359088 run osmo-hlr_10.42.42.2(pid=18902): stdout: | (launched: 2022-12-14_11:58:06.933171) 11:58:10.411098 run osmo-hlr_10.42.42.2(pid=18902): stderr: | [0;m[1;31m20221214115807132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115807132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115807132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115807132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115807132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115807132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115807144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115807154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115807154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115807154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:10.463357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18901): Terminating (SIGTERM) 11:58:10.505384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18904): Terminating (SIGTERM) 11:58:10.547493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18907): Terminating (SIGTERM) 11:58:10.590410 --- ParallelTerminationStrategy: PID 18901 died... 11:58:10.610544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18901): Terminated: ok {rc=0} 11:58:10.657041 --- ParallelTerminationStrategy: PID 18904 died... 11:58:10.676744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18904): Terminated: ok {rc=0} 11:58:10.723146 --- ParallelTerminationStrategy: PID 18907 died... 11:58:10.743009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18907): Terminated: ok {rc=0} 11:58:10.831719 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 11:58:12.141126 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:58:12.146893 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:58:12.180715 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:58:12.220077 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:58:12.306724 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:58:12.341559 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:58:12.380854 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:58:12.978877 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:58:13.031386 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:13.042815 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:58:13.093712 tst cs_paging_gprs_active.py: using LAC 40739 11:58:13.221874 tst cs_paging_gprs_active.py: using RAC 194 11:58:13.349952 tst cs_paging_gprs_active.py: using CellId 40739 11:58:13.471968 tst cs_paging_gprs_active.py: using BVCI 40740 11:58:13.584062 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:13.595084 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:13.605879 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:13.616787 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:13.627763 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:13.638829 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:13.649951 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:13.660768 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:13.671898 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:13.794506 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:13.915123 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:58:14.136404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:14.466117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18912): Launched 11:58:14.752785 run iperf3-srv_10.42.42.10(pid=18913): Launched 11:58:14.877647 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:58:15.098515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:15.429066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18914): Launched 11:58:15.714852 run iperf3-srv_10.42.42.10(pid=18915): Launched 11:58:15.839119 tst cs_paging_gprs_active.py:38: start network... 11:58:16.063290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:16.579240 run create_hlr_db(pid=18916): Launched 11:58:16.745078 bus /gobi_6: Setting Powered False 11:58:17.806143 run create_hlr_db(pid=18916): Terminated: ok {rc=0} 11:58:18.268152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18918): Launched 11:58:18.598657 run osmo-hlr_10.42.42.2(pid=18919): Launched 11:58:18.724150 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:19.287976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18921): Launched 11:58:19.618192 run osmo-stp_10.42.42.5(pid=18922): Launched 11:58:19.744477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:20.310952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18924): Launched 11:58:20.438375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:20.715893 run patchelf(pid=18925): Launched 11:58:20.897993 run osmo-stp_10.42.42.5(pid=18922): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18922)] 11:58:21.036927 run osmo-stp_10.42.42.5(pid=18922): stdout: | (launched: 2022-12-14_11:58:19.557810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:21.177650 run osmo-stp_10.42.42.5(pid=18922): stderr: | [0;m[38;5;43m20221214115819747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115819747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115819747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115819747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115819748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115819748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115819748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:21.318369 run osmo-stp_10.42.42.5(pid=18922): stdout: | (launched: 2022-12-14_11:58:19.557810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:21.453941 run osmo-stp_10.42.42.5(pid=18922): stderr: | [0;m[38;5;43m20221214115819747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115819747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115819747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115819747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115819748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115819748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115819748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:21.613564 run patchelf(pid=18925): Terminating (SIGINT) 11:58:21.797546 run patchelf(pid=18925): Terminated: ok {rc=0} 11:58:21.929966 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18922): Process ended prematurely: osmo-stp_10.42.42.5(pid=18922) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18922)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:58:21.940151 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:58:21.968579 run osmo-hlr_10.42.42.2(pid=18919): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18919)] 11:58:22.018553 run osmo-hlr_10.42.42.2(pid=18919): stdout: | (launched: 2022-12-14_11:58:18.538177) 11:58:22.070104 run osmo-hlr_10.42.42.2(pid=18919): stderr: | [0;m[1;31m20221214115818735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115818735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115818735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115818736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115818736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115818736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115818748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115818757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115818757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115818757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:22.122004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18912): Terminating (SIGTERM) 11:58:22.163697 run iperf3-srv_10.42.42.10(pid=18913): Terminating (SIGTERM) 11:58:22.205305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18914): Terminating (SIGTERM) 11:58:22.247190 run iperf3-srv_10.42.42.10(pid=18915): Terminating (SIGTERM) 11:58:22.288804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18918): Terminating (SIGTERM) 11:58:22.331180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18921): Terminating (SIGTERM) 11:58:22.373483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18924): Terminating (SIGTERM) 11:58:22.415601 --- ParallelTerminationStrategy: PID 18912 died... 11:58:22.435638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18912): Terminated: ok {rc=0} 11:58:22.481839 --- ParallelTerminationStrategy: PID 18913 died... 11:58:22.501329 run iperf3-srv_10.42.42.10(pid=18913): Terminated {rc=256} 11:58:22.548808 --- ParallelTerminationStrategy: PID 18914 died... 11:58:22.568867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18914): Terminated: ok {rc=0} 11:58:22.615026 --- ParallelTerminationStrategy: PID 18915 died... 11:58:22.634765 run iperf3-srv_10.42.42.10(pid=18915): Terminated {rc=256} 11:58:22.680845 --- ParallelTerminationStrategy: PID 18918 died... 11:58:22.700888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18918): Terminated: ok {rc=0} 11:58:22.746904 --- ParallelTerminationStrategy: PID 18921 died... 11:58:22.766564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18921): Terminated: ok {rc=0} 11:58:22.812685 --- ParallelTerminationStrategy: PID 18924 died... 11:58:22.832399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18924): Terminated: ok {rc=0} 11:58:22.920634 bus /gobi_0: Setting Powered False 11:58:24.019823 bus /gobi_0: Setting Powered False 11:58:25.138592 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:58:26.285980 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:26.297847 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:58:26.357069 tst iperf3.py: using LAC 40740 11:58:26.483894 tst iperf3.py: using RAC 195 11:58:26.614774 tst iperf3.py: using CellId 40740 11:58:26.742752 tst iperf3.py: using BVCI 40741 11:58:26.862690 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:26.874307 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:26.885621 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:26.896823 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:26.908119 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:26.919372 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:26.930704 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:26.941884 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:26.953311 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:27.070011 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:58:27.274454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:27.581274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18926): Launched 11:58:27.848092 run iperf3-srv_10.42.42.10(pid=18927): Launched 11:58:27.962128 tst iperf3.py:8: start network... 11:58:28.165472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:28.637404 run create_hlr_db(pid=18928): Launched 11:58:28.754627 bus /gobi_6: Setting Powered False 11:58:29.815488 run create_hlr_db(pid=18928): Terminated: ok {rc=0} 11:58:30.241880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18930): Launched 11:58:30.549586 run osmo-hlr_10.42.42.2(pid=18931): Launched 11:58:30.666347 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:31.254812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18933): Launched 11:58:31.578056 run osmo-stp_10.42.42.5(pid=18934): Launched 11:58:31.874439 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:32.453206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18936): Launched 11:58:32.579360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:32.858011 run patchelf(pid=18937): Launched 11:58:33.039660 run osmo-stp_10.42.42.5(pid=18934): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18934)] 11:58:33.178408 run osmo-stp_10.42.42.5(pid=18934): stdout: | (launched: 2022-12-14_11:58:31.520535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:33.318728 run osmo-stp_10.42.42.5(pid=18934): stderr: | [0;m[38;5;43m20221214115831784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115831784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115831785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115831785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115831786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115831786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115831786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:33.459627 run osmo-stp_10.42.42.5(pid=18934): stdout: | (launched: 2022-12-14_11:58:31.520535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:33.593862 run osmo-stp_10.42.42.5(pid=18934): stderr: | [0;m[38;5;43m20221214115831784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115831784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115831785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115831785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115831786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115831786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115831786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:33.752630 run patchelf(pid=18937): Terminating (SIGINT) 11:58:33.935493 run patchelf(pid=18937): Terminated: ok {rc=0} 11:58:34.067537 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18934): Process ended prematurely: osmo-stp_10.42.42.5(pid=18934) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18934)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 11:58:34.077955 tst iperf3.py:8: Test FAILED (7.8 sec) 11:58:34.106197 run osmo-hlr_10.42.42.2(pid=18931): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18931)] 11:58:34.156146 run osmo-hlr_10.42.42.2(pid=18931): stdout: | (launched: 2022-12-14_11:58:30.492931) 11:58:34.207645 run osmo-hlr_10.42.42.2(pid=18931): stderr: | [0;m[1;31m20221214115830668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115830668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115830668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115830668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115830668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115830668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115830680 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115830689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115830689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115830689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:34.259662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18926): Terminating (SIGTERM) 11:58:34.301843 run iperf3-srv_10.42.42.10(pid=18927): Terminating (SIGTERM) 11:58:34.344255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18930): Terminating (SIGTERM) 11:58:34.386968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18933): Terminating (SIGTERM) 11:58:34.429092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18936): Terminating (SIGTERM) 11:58:34.471571 --- ParallelTerminationStrategy: PID 18926 died... 11:58:34.491473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18926): Terminated: ok {rc=0} 11:58:34.537535 --- ParallelTerminationStrategy: PID 18927 died... 11:58:34.557047 run iperf3-srv_10.42.42.10(pid=18927): Terminated {rc=256} 11:58:34.602952 --- ParallelTerminationStrategy: PID 18930 died... 11:58:34.622470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18930): Terminated: ok {rc=0} 11:58:34.668527 --- ParallelTerminationStrategy: PID 18933 died... 11:58:34.688183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18933): Terminated: ok {rc=0} 11:58:34.734023 --- ParallelTerminationStrategy: PID 18936 died... 11:58:34.753524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18936): Terminated: ok {rc=0} 11:58:34.841971 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:58:35.992055 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:36.004214 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:58:36.057677 tst iperf3m4.py: using LAC 40741 11:58:36.188913 tst iperf3m4.py: using RAC 196 11:58:36.317256 tst iperf3m4.py: using CellId 40741 11:58:36.444438 tst iperf3m4.py: using BVCI 40742 11:58:36.556635 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:36.568122 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:36.579246 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:36.590411 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:36.601730 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:36.612910 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:36.624262 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:36.635405 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:36.646705 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:36.769133 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:36.888671 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:37.007096 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:37.129168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:58:37.349879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:37.679342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18938): Launched 11:58:37.968010 run iperf3-srv_10.42.42.10(pid=18939): Launched 11:58:38.091783 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:58:38.312216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:38.641935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18940): Launched 11:58:38.926918 run iperf3-srv_10.42.42.10(pid=18941): Launched 11:58:39.050417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:58:39.270395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:39.599388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18942): Launched 11:58:39.883891 run iperf3-srv_10.42.42.10(pid=18943): Launched 11:58:40.008705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:58:40.228735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:40.558371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18944): Launched 11:58:40.843705 run iperf3-srv_10.42.42.10(pid=18945): Launched 11:58:40.967076 tst iperf3m4.py:8: start network... 11:58:41.186933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:41.694299 run create_hlr_db(pid=18946): Launched 11:58:41.828000 bus /gobi_6: Setting Powered False 11:58:42.893117 run create_hlr_db(pid=18946): Terminated: ok {rc=0} 11:58:43.349736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18948): Launched 11:58:43.678554 run osmo-hlr_10.42.42.2(pid=18949): Launched 11:58:43.803287 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:44.368581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18951): Launched 11:58:44.698741 run osmo-stp_10.42.42.5(pid=18952): Launched 11:58:44.824384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:45.390491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18954): Launched 11:58:45.515055 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:45.791924 run patchelf(pid=18955): Launched 11:58:45.976914 run osmo-stp_10.42.42.5(pid=18952): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18952)] 11:58:46.117644 run osmo-stp_10.42.42.5(pid=18952): stdout: | (launched: 2022-12-14_11:58:44.637889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:46.259888 run osmo-stp_10.42.42.5(pid=18952): stderr: | [0;m[38;5;43m20221214115844827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115844827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115844827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115844827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115844828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115844828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115844828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:46.403255 run osmo-stp_10.42.42.5(pid=18952): stdout: | (launched: 2022-12-14_11:58:44.637889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:46.539671 run osmo-stp_10.42.42.5(pid=18952): stderr: | [0;m[38;5;43m20221214115844827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115844827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115844827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115844827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115844828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115844828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115844828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:46.701161 run patchelf(pid=18955): Terminating (SIGINT) 11:58:46.887688 run patchelf(pid=18955): Terminated: ok {rc=0} 11:58:47.021375 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18952): Process ended prematurely: osmo-stp_10.42.42.5(pid=18952) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18952)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 11:58:47.032768 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:58:47.063188 run osmo-hlr_10.42.42.2(pid=18949): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18949)] 11:58:47.114804 run osmo-hlr_10.42.42.2(pid=18949): stdout: | (launched: 2022-12-14_11:58:43.617956) 11:58:47.167903 run osmo-hlr_10.42.42.2(pid=18949): stderr: | [0;m[1;31m20221214115843814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115843814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115843814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115843814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115843814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115843814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115843831 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115843841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115843841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115843841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:47.220827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18938): Terminating (SIGTERM) 11:58:47.262772 run iperf3-srv_10.42.42.10(pid=18939): Terminating (SIGTERM) 11:58:47.305247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18940): Terminating (SIGTERM) 11:58:47.347726 run iperf3-srv_10.42.42.10(pid=18941): Terminating (SIGTERM) 11:58:47.389767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18942): Terminating (SIGTERM) 11:58:47.432271 run iperf3-srv_10.42.42.10(pid=18943): Terminating (SIGTERM) 11:58:47.474104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18944): Terminating (SIGTERM) 11:58:47.516527 run iperf3-srv_10.42.42.10(pid=18945): Terminating (SIGTERM) 11:58:47.558426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18948): Terminating (SIGTERM) 11:58:47.600823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18951): Terminating (SIGTERM) 11:58:47.642816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18954): Terminating (SIGTERM) 11:58:47.685493 --- ParallelTerminationStrategy: PID 18938 died... 11:58:47.705573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18938): Terminated: ok {rc=0} 11:58:47.751965 --- ParallelTerminationStrategy: PID 18939 died... 11:58:47.771485 run iperf3-srv_10.42.42.10(pid=18939): Terminated {rc=256} 11:58:47.817493 --- ParallelTerminationStrategy: PID 18940 died... 11:58:47.837086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18940): Terminated: ok {rc=0} 11:58:47.883322 --- ParallelTerminationStrategy: PID 18941 died... 11:58:47.902902 run iperf3-srv_10.42.42.10(pid=18941): Terminated {rc=256} 11:58:47.949066 --- ParallelTerminationStrategy: PID 18942 died... 11:58:47.968760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18942): Terminated: ok {rc=0} 11:58:48.014995 --- ParallelTerminationStrategy: PID 18943 died... 11:58:48.034672 run iperf3-srv_10.42.42.10(pid=18943): Terminated {rc=256} 11:58:48.080758 --- ParallelTerminationStrategy: PID 18944 died... 11:58:48.100347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18944): Terminated: ok {rc=0} 11:58:48.146828 --- ParallelTerminationStrategy: PID 18945 died... 11:58:48.166635 run iperf3-srv_10.42.42.10(pid=18945): Terminated {rc=256} 11:58:48.212684 --- ParallelTerminationStrategy: PID 18948 died... 11:58:48.232370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18948): Terminated: ok {rc=0} 11:58:48.278516 --- ParallelTerminationStrategy: PID 18951 died... 11:58:48.298214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18951): Terminated: ok {rc=0} 11:58:48.344762 --- ParallelTerminationStrategy: PID 18954 died... 11:58:48.364510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18954): Terminated: ok {rc=0} 11:58:48.452823 bus /gobi_4: Setting Powered False 11:58:49.552461 bus /gobi_4: Setting Powered False 11:58:50.669513 bus /gobi_1: Setting Powered False 11:58:51.769022 bus /gobi_1: Setting Powered False 11:58:52.885232 bus /gobi_0: Setting Powered False 11:58:53.983049 bus /gobi_0: Setting Powered False 11:58:55.104381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 11:58:56.208219 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:56.220080 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:58:56.270929 tst ping.py: using LAC 40742 11:58:56.390931 tst ping.py: using RAC 197 11:58:56.514940 tst ping.py: using CellId 40742 11:58:56.632360 tst ping.py: using BVCI 40743 11:58:56.741687 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:56.752648 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:56.763509 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:56.774436 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:56.785950 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:56.797612 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:56.809468 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:56.821154 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:56.938761 tst ping.py:19: start network... 11:58:57.140700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:57.606318 run create_hlr_db(pid=18956): Launched 11:58:57.721717 bus /gobi_6: Setting Powered False 11:58:58.781762 run create_hlr_db(pid=18956): Terminated: ok {rc=0} 11:58:59.225891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18958): Launched 11:58:59.548443 run osmo-hlr_10.42.42.2(pid=18959): Launched 11:58:59.671679 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:00.233467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18961): Launched 11:59:00.558514 run osmo-stp_10.42.42.5(pid=18962): Launched 11:59:00.682458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:01.257768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18964): Launched 11:59:01.384240 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:01.651510 run patchelf(pid=18965): Launched 11:59:01.841646 run osmo-stp_10.42.42.5(pid=18962): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18962)] 11:59:01.977537 run osmo-stp_10.42.42.5(pid=18962): stdout: | (launched: 2022-12-14_11:59:00.498832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:02.116590 run osmo-stp_10.42.42.5(pid=18962): stderr: | [0;m[38;5;43m20221214115900691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115900691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115900691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115900691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115900692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115900692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115900692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:02.250695 run osmo-stp_10.42.42.5(pid=18962): stdout: | (launched: 2022-12-14_11:59:00.498832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:02.374172 run osmo-stp_10.42.42.5(pid=18962): stderr: | [0;m[38;5;43m20221214115900691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115900691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115900691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115900691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115900692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115900692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115900692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:02.520792 run patchelf(pid=18965): Terminating (SIGINT) 11:59:02.690727 run patchelf(pid=18965): Terminated: ok {rc=0} 11:59:02.812569 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18962): Process ended prematurely: osmo-stp_10.42.42.5(pid=18962) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18962)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 11:59:02.821747 tst ping.py:22: Test FAILED (6.6 sec) 11:59:02.849096 run osmo-hlr_10.42.42.2(pid=18959): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18959)] 11:59:02.898574 run osmo-hlr_10.42.42.2(pid=18959): stdout: | (launched: 2022-12-14_11:58:59.488736) 11:59:02.949258 run osmo-hlr_10.42.42.2(pid=18959): stderr: | [0;m[1;31m20221214115859686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115859686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115859686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115859686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115859686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115859686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115859699 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115859708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115859708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115859708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:03.000222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18958): Terminating (SIGTERM) 11:59:03.041424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18961): Terminating (SIGTERM) 11:59:03.082759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18964): Terminating (SIGTERM) 11:59:03.124102 --- ParallelTerminationStrategy: PID 18958 died... 11:59:03.143967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18958): Terminated: ok {rc=0} 11:59:03.189381 --- ParallelTerminationStrategy: PID 18961 died... 11:59:03.208747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18961): Terminated: ok {rc=0} 11:59:03.253714 --- ParallelTerminationStrategy: PID 18964 died... 11:59:03.273070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18964): Terminated: ok {rc=0} 11:59:03.361102 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:59:04.451268 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:04.463509 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:59:04.516284 tst ping_idle_ping.py: using LAC 40743 11:59:04.635185 tst ping_idle_ping.py: using RAC 198 11:59:04.752585 tst ping_idle_ping.py: using CellId 40743 11:59:04.869271 tst ping_idle_ping.py: using BVCI 40744 11:59:04.978103 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:04.989298 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:05.000157 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:05.011031 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:05.022192 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:05.033257 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:05.044535 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:05.055657 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:59:05.177213 tst ping_idle_ping.py:24: start network... 11:59:05.395894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:05.899013 run create_hlr_db(pid=18966): Launched 11:59:06.029615 bus /gobi_6: Setting Powered False 11:59:07.093633 run create_hlr_db(pid=18966): Terminated: ok {rc=0} 11:59:07.526813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18968): Launched 11:59:07.828097 run osmo-hlr_10.42.42.2(pid=18969): Launched 11:59:07.942181 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:08.459244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18971): Launched 11:59:08.759312 run osmo-stp_10.42.42.5(pid=18972): Launched 11:59:08.873423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:09.392413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18974): Launched 11:59:09.507552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:09.762813 run patchelf(pid=18975): Launched 11:59:09.932268 run osmo-stp_10.42.42.5(pid=18972): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18972)] 11:59:10.060213 run osmo-stp_10.42.42.5(pid=18972): stdout: | (launched: 2022-12-14_11:59:08.703455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:10.190873 run osmo-stp_10.42.42.5(pid=18972): stderr: | [0;m[38;5;43m20221214115908872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115908872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115908872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115908873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115908874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115908874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115908874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:10.320489 run osmo-stp_10.42.42.5(pid=18972): stdout: | (launched: 2022-12-14_11:59:08.703455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:10.443807 run osmo-stp_10.42.42.5(pid=18972): stderr: | [0;m[38;5;43m20221214115908872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115908872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115908872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115908873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115908874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115908874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115908874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:10.589831 run patchelf(pid=18975): Terminating (SIGINT) 11:59:10.758791 run patchelf(pid=18975): Terminated: ok {rc=0} 11:59:10.880426 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18972): Process ended prematurely: osmo-stp_10.42.42.5(pid=18972) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18972)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 11:59:10.889566 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:59:10.916361 run osmo-hlr_10.42.42.2(pid=18969): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18969)] 11:59:10.964466 run osmo-hlr_10.42.42.2(pid=18969): stdout: | (launched: 2022-12-14_11:59:07.772360) 11:59:11.013819 run osmo-hlr_10.42.42.2(pid=18969): stderr: | [0;m[1;31m20221214115907946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115907946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115907946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115907946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115907946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115907946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115907958 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115907966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115907966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115907967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:11.063667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18968): Terminating (SIGTERM) 11:59:11.103850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18971): Terminating (SIGTERM) 11:59:11.144078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18974): Terminating (SIGTERM) 11:59:11.184430 --- ParallelTerminationStrategy: PID 18968 died... 11:59:11.204109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18968): Terminated: ok {rc=0} 11:59:11.248705 --- ParallelTerminationStrategy: PID 18971 died... 11:59:11.267851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18971): Terminated: ok {rc=0} 11:59:11.311925 --- ParallelTerminationStrategy: PID 18974 died... 11:59:11.331077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18974): Terminated: ok {rc=0} 11:59:11.415254 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:59:12.731749 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:59:12.738937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:59:12.773964 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:59:12.812799 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:59:12.901896 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:59:12.935473 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:59:12.974261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:59:13.566105 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:59:13.616684 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:13.627687 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:59:13.698177 tst cs_paging_gprs_active.py: using LAC 40744 11:59:13.818140 tst cs_paging_gprs_active.py: using RAC 199 11:59:13.936825 tst cs_paging_gprs_active.py: using CellId 40744 11:59:14.055985 tst cs_paging_gprs_active.py: using BVCI 40745 11:59:14.168698 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:14.179805 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:14.190635 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:14.201492 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:14.212581 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:14.223728 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:14.234974 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:14.246062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:14.257343 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:14.380810 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:14.500357 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:59:14.705665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:15.013110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18980): Launched 11:59:15.280305 run iperf3-srv_10.42.42.10(pid=18981): Launched 11:59:15.395439 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:59:15.599281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:15.921660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18982): Launched 11:59:16.194293 run iperf3-srv_10.42.42.10(pid=18983): Launched 11:59:16.335512 tst cs_paging_gprs_active.py:38: start network... 11:59:16.567642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:17.095878 run create_hlr_db(pid=18984): Launched 11:59:17.253192 bus /gobi_6: Setting Powered False 11:59:18.317753 run create_hlr_db(pid=18984): Terminated: ok {rc=0} 11:59:18.757330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18986): Launched 11:59:19.064088 run osmo-hlr_10.42.42.2(pid=18987): Launched 11:59:19.180833 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:19.721322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18989): Launched 11:59:20.027518 run osmo-stp_10.42.42.5(pid=18990): Launched 11:59:20.143061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:20.670786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18992): Launched 11:59:20.789729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:21.049161 run patchelf(pid=18993): Launched 11:59:21.219156 run osmo-stp_10.42.42.5(pid=18990): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18990)] 11:59:21.349148 run osmo-stp_10.42.42.5(pid=18990): stdout: | (launched: 2022-12-14_11:59:19.970755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:21.481167 run osmo-stp_10.42.42.5(pid=18990): stderr: | [0;m[38;5;43m20221214115920143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115920143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115920143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115920144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115920144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115920144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115920144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:21.613346 run osmo-stp_10.42.42.5(pid=18990): stdout: | (launched: 2022-12-14_11:59:19.970755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:21.738974 run osmo-stp_10.42.42.5(pid=18990): stderr: | [0;m[38;5;43m20221214115920143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115920143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115920143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115920144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115920144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115920144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115920144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:21.887652 run patchelf(pid=18993): Terminating (SIGINT) 11:59:22.059612 run patchelf(pid=18993): Terminated: ok {rc=0} 11:59:22.184346 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18990): Process ended prematurely: osmo-stp_10.42.42.5(pid=18990) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18990)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:59:22.194321 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:59:22.221710 run osmo-hlr_10.42.42.2(pid=18987): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18987)] 11:59:22.270755 run osmo-hlr_10.42.42.2(pid=18987): stdout: | (launched: 2022-12-14_11:59:19.007409) 11:59:22.320710 run osmo-hlr_10.42.42.2(pid=18987): stderr: | [0;m[1;31m20221214115919182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115919182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115919182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115919182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115919182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115919182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115919194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115919202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115919202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115919202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:22.371157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18980): Terminating (SIGTERM) 11:59:22.411693 run iperf3-srv_10.42.42.10(pid=18981): Terminating (SIGTERM) 11:59:22.452118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18982): Terminating (SIGTERM) 11:59:22.492621 run iperf3-srv_10.42.42.10(pid=18983): Terminating (SIGTERM) 11:59:22.532835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18986): Terminating (SIGTERM) 11:59:22.573298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18989): Terminating (SIGTERM) 11:59:22.613841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18992): Terminating (SIGTERM) 11:59:22.654463 --- ParallelTerminationStrategy: PID 18980 died... 11:59:22.674175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18980): Terminated: ok {rc=0} 11:59:22.718655 --- ParallelTerminationStrategy: PID 18981 died... 11:59:22.737613 run iperf3-srv_10.42.42.10(pid=18981): Terminated {rc=256} 11:59:22.781603 --- ParallelTerminationStrategy: PID 18982 died... 11:59:22.800439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18982): Terminated: ok {rc=0} 11:59:22.844674 --- ParallelTerminationStrategy: PID 18983 died... 11:59:22.863637 run iperf3-srv_10.42.42.10(pid=18983): Terminated {rc=256} 11:59:22.907572 --- ParallelTerminationStrategy: PID 18986 died... 11:59:22.926954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18986): Terminated: ok {rc=0} 11:59:22.971182 --- ParallelTerminationStrategy: PID 18989 died... 11:59:22.990303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18989): Terminated: ok {rc=0} 11:59:23.034342 --- ParallelTerminationStrategy: PID 18992 died... 11:59:23.053368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18992): Terminated: ok {rc=0} 11:59:23.139936 bus /gobi_0: Setting Powered False 11:59:24.242969 bus /gobi_0: Setting Powered False 11:59:25.362220 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:59:26.514384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:26.526924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:59:26.602655 tst iperf3.py: using LAC 40745 11:59:26.730152 tst iperf3.py: using RAC 200 11:59:26.857929 tst iperf3.py: using CellId 40745 11:59:26.985375 tst iperf3.py: using BVCI 40746 11:59:27.104370 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:27.115988 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:27.127376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:27.138797 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:27.150187 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:27.161595 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:27.172939 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:27.184212 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:27.195793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:27.313370 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:59:27.519582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:27.826588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18994): Launched 11:59:28.095293 run iperf3-srv_10.42.42.10(pid=18995): Launched 11:59:28.209638 tst iperf3.py:8: start network... 11:59:28.413806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:28.886846 run create_hlr_db(pid=18996): Launched 11:59:29.003485 bus /gobi_6: Setting Powered False 11:59:30.063886 run create_hlr_db(pid=18996): Terminated: ok {rc=0} 11:59:30.515141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18998): Launched 11:59:30.854167 run osmo-hlr_10.42.42.2(pid=18999): Launched 11:59:31.118956 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:31.826583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19001): Launched 11:59:32.169478 run osmo-stp_10.42.42.5(pid=19002): Launched 11:59:32.374138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:32.903161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19004): Launched 11:59:33.021692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:33.280544 run patchelf(pid=19005): Launched 11:59:33.450979 run osmo-stp_10.42.42.5(pid=19002): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19002)] 11:59:33.580826 run osmo-stp_10.42.42.5(pid=19002): stdout: | (launched: 2022-12-14_11:59:32.109372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:33.712314 run osmo-stp_10.42.42.5(pid=19002): stderr: | [0;m[38;5;43m20221214115932368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115932368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115932368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115932369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115932369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115932369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115932369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:33.843865 run osmo-stp_10.42.42.5(pid=19002): stdout: | (launched: 2022-12-14_11:59:32.109372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:33.969333 run osmo-stp_10.42.42.5(pid=19002): stderr: | [0;m[38;5;43m20221214115932368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115932368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115932368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115932369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115932369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115932369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115932369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:34.118150 run patchelf(pid=19005): Terminating (SIGINT) 11:59:34.290569 run patchelf(pid=19005): Terminated: ok {rc=0} 11:59:34.415569 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19002): Process ended prematurely: osmo-stp_10.42.42.5(pid=19002) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19002)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 11:59:34.425226 tst iperf3.py:8: Test FAILED (8.0 sec) 11:59:34.453273 run osmo-hlr_10.42.42.2(pid=18999): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18999)] 11:59:34.501735 run osmo-hlr_10.42.42.2(pid=18999): stdout: | (launched: 2022-12-14_11:59:30.783753) 11:59:34.551228 run osmo-hlr_10.42.42.2(pid=18999): stderr: | [0;m[1;31m20221214115931095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115931095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115931095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115931095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115931095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115931095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115931113 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115931140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115931140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115931141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:34.601461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18994): Terminating (SIGTERM) 11:59:34.641793 run iperf3-srv_10.42.42.10(pid=18995): Terminating (SIGTERM) 11:59:34.681936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18998): Terminating (SIGTERM) 11:59:34.722109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19001): Terminating (SIGTERM) 11:59:34.762156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19004): Terminating (SIGTERM) 11:59:34.802435 --- ParallelTerminationStrategy: PID 18994 died... 11:59:34.821861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18994): Terminated: ok {rc=0} 11:59:34.866212 --- ParallelTerminationStrategy: PID 18995 died... 11:59:34.885092 run iperf3-srv_10.42.42.10(pid=18995): Terminated {rc=256} 11:59:34.929088 --- ParallelTerminationStrategy: PID 18998 died... 11:59:34.947952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18998): Terminated: ok {rc=0} 11:59:34.991884 --- ParallelTerminationStrategy: PID 19001 died... 11:59:35.010810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19001): Terminated: ok {rc=0} 11:59:35.054807 --- ParallelTerminationStrategy: PID 19004 died... 11:59:35.073783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19004): Terminated: ok {rc=0} 11:59:35.160078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:59:36.307707 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:36.319834 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:59:36.390670 tst iperf3m4.py: using LAC 40746 11:59:36.512019 tst iperf3m4.py: using RAC 201 11:59:36.633362 tst iperf3m4.py: using CellId 40746 11:59:36.753921 tst iperf3m4.py: using BVCI 40747 11:59:36.865165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:36.876303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:36.887240 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:36.898074 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:36.909275 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:36.920754 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:36.932088 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:36.943150 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:36.954537 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:37.076348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:37.197433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:37.319562 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:37.440009 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:59:37.646914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:37.956368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19006): Launched 11:59:38.225684 run iperf3-srv_10.42.42.10(pid=19007): Launched 11:59:38.340610 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:59:38.547011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:38.854765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19008): Launched 11:59:39.120889 run iperf3-srv_10.42.42.10(pid=19009): Launched 11:59:39.235013 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:59:39.439194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:39.746061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19010): Launched 11:59:40.014502 run iperf3-srv_10.42.42.10(pid=19011): Launched 11:59:40.128882 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:59:40.333063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:40.641240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19012): Launched 11:59:40.907874 run iperf3-srv_10.42.42.10(pid=19013): Launched 11:59:41.022202 tst iperf3m4.py:8: start network... 11:59:41.225987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:41.698714 run create_hlr_db(pid=19014): Launched 11:59:41.817304 bus /gobi_6: Setting Powered False 11:59:42.877958 run create_hlr_db(pid=19014): Terminated: ok {rc=0} 11:59:43.304783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19016): Launched 11:59:43.611625 run osmo-hlr_10.42.42.2(pid=19017): Launched 11:59:43.727925 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:44.267379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19019): Launched 11:59:44.575685 run osmo-stp_10.42.42.5(pid=19020): Launched 11:59:44.693688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:45.220644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19022): Launched 11:59:45.338779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:45.597285 run patchelf(pid=19023): Launched 11:59:45.768214 run osmo-stp_10.42.42.5(pid=19020): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19020)] 11:59:45.917180 run osmo-stp_10.42.42.5(pid=19020): stdout: | (launched: 2022-12-14_11:59:44.518804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:46.050951 run osmo-stp_10.42.42.5(pid=19020): stderr: | [0;m[38;5;43m20221214115944687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115944688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115944688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115944688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115944689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115944689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115944689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:46.185550 run osmo-stp_10.42.42.5(pid=19020): stdout: | (launched: 2022-12-14_11:59:44.518804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:46.313730 run osmo-stp_10.42.42.5(pid=19020): stderr: | [0;m[38;5;43m20221214115944687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214115944688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214115944688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214115944688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214115944689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214115944689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214115944689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:46.465696 run patchelf(pid=19023): Terminating (SIGINT) 11:59:46.640507 run patchelf(pid=19023): Terminated: ok {rc=0} 11:59:46.767605 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19020): Process ended prematurely: osmo-stp_10.42.42.5(pid=19020) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19020)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:59:46.778400 tst iperf3m4.py:8: Test FAILED (10.5 sec) 11:59:46.807330 run osmo-hlr_10.42.42.2(pid=19017): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19017)] 11:59:46.859858 run osmo-hlr_10.42.42.2(pid=19017): stdout: | (launched: 2022-12-14_11:59:43.554438) 11:59:46.910656 run osmo-hlr_10.42.42.2(pid=19017): stderr: | [0;m[1;31m20221214115943728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115943728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115943728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115943728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115943728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115943728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115943740 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115943748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115943748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115943748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:46.964328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19006): Terminating (SIGTERM) 11:59:47.005783 run iperf3-srv_10.42.42.10(pid=19007): Terminating (SIGTERM) 11:59:47.047951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19008): Terminating (SIGTERM) 11:59:47.090897 run iperf3-srv_10.42.42.10(pid=19009): Terminating (SIGTERM) 11:59:47.134647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19010): Terminating (SIGTERM) 11:59:47.177211 run iperf3-srv_10.42.42.10(pid=19011): Terminating (SIGTERM) 11:59:47.219303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19012): Terminating (SIGTERM) 11:59:47.262526 run iperf3-srv_10.42.42.10(pid=19013): Terminating (SIGTERM) 11:59:47.304532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19016): Terminating (SIGTERM) 11:59:47.347195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19019): Terminating (SIGTERM) 11:59:47.389914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19022): Terminating (SIGTERM) 11:59:47.432160 --- ParallelTerminationStrategy: PID 19006 died... 11:59:47.452188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19006): Terminated: ok {rc=0} 11:59:47.498711 --- ParallelTerminationStrategy: PID 19007 died... 11:59:47.518295 run iperf3-srv_10.42.42.10(pid=19007): Terminated {rc=256} 11:59:47.564334 --- ParallelTerminationStrategy: PID 19008 died... 11:59:47.584017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19008): Terminated: ok {rc=0} 11:59:47.630304 --- ParallelTerminationStrategy: PID 19009 died... 11:59:47.649987 run iperf3-srv_10.42.42.10(pid=19009): Terminated {rc=256} 11:59:47.696147 --- ParallelTerminationStrategy: PID 19010 died... 11:59:47.715979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19010): Terminated: ok {rc=0} 11:59:47.762320 --- ParallelTerminationStrategy: PID 19011 died... 11:59:47.782078 run iperf3-srv_10.42.42.10(pid=19011): Terminated {rc=256} 11:59:47.828150 --- ParallelTerminationStrategy: PID 19012 died... 11:59:47.847863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19012): Terminated: ok {rc=0} 11:59:47.893993 --- ParallelTerminationStrategy: PID 19013 died... 11:59:47.913801 run iperf3-srv_10.42.42.10(pid=19013): Terminated {rc=256} 11:59:47.959903 --- ParallelTerminationStrategy: PID 19016 died... 11:59:47.979485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19016): Terminated: ok {rc=0} 11:59:48.025820 --- ParallelTerminationStrategy: PID 19019 died... 11:59:48.045547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19019): Terminated: ok {rc=0} 11:59:48.091981 --- ParallelTerminationStrategy: PID 19022 died... 11:59:48.111747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19022): Terminated: ok {rc=0} 11:59:48.199788 bus /gobi_4: Setting Powered False 11:59:49.299329 bus /gobi_4: Setting Powered False 11:59:50.418252 bus /gobi_1: Setting Powered False 11:59:51.517413 bus /gobi_1: Setting Powered False 11:59:52.631703 bus /gobi_0: Setting Powered False 11:59:53.731105 bus /gobi_0: Setting Powered False 11:59:54.848072 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:59:55.950928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:55.963146 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:59:56.037216 tst ping.py: using LAC 40747 11:59:56.168073 tst ping.py: using RAC 202 11:59:56.294194 tst ping.py: using CellId 40747 11:59:56.418544 tst ping.py: using BVCI 40748 11:59:56.536267 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:56.547880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:56.559422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:56.570871 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:56.582210 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:56.593633 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:56.605166 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:56.616513 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:56.733156 tst ping.py:19: start network... 11:59:56.933216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:57.396567 run create_hlr_db(pid=19024): Launched 11:59:57.512182 bus /gobi_6: Setting Powered False 11:59:58.572659 run create_hlr_db(pid=19024): Terminated: ok {rc=0} 11:59:59.012423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19026): Launched 11:59:59.336261 run osmo-hlr_10.42.42.2(pid=19027): Launched 11:59:59.460513 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:00.017641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19029): Launched 12:00:00.338304 run osmo-stp_10.42.42.5(pid=19030): Launched 12:00:00.461805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:01.040447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19032): Launched 12:00:01.174375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:01.452766 run patchelf(pid=19033): Launched 12:00:01.644018 run osmo-stp_10.42.42.5(pid=19030): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19030)] 12:00:01.791627 run osmo-stp_10.42.42.5(pid=19030): stdout: | (launched: 2022-12-14_12:00:00.278821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:01.948652 run osmo-stp_10.42.42.5(pid=19030): stderr: | [0;m[38;5;43m20221214120000470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120000470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120000470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120000471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120000471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120000471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120000471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:02.092606 run osmo-stp_10.42.42.5(pid=19030): stdout: | (launched: 2022-12-14_12:00:00.278821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:02.229515 run osmo-stp_10.42.42.5(pid=19030): stderr: | [0;m[38;5;43m20221214120000470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120000470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120000470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120000471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120000471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120000471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120000471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:02.391445 run patchelf(pid=19033): Terminating (SIGINT) 12:00:02.582075 run patchelf(pid=19033): Terminated: ok {rc=0} 12:00:02.714918 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19030): Process ended prematurely: osmo-stp_10.42.42.5(pid=19030) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19030)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 12:00:02.724912 tst ping.py:22: Test FAILED (6.8 sec) 12:00:02.754744 run osmo-hlr_10.42.42.2(pid=19027): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19027)] 12:00:02.805908 run osmo-hlr_10.42.42.2(pid=19027): stdout: | (launched: 2022-12-14_11:59:59.277063) 12:00:02.857703 run osmo-hlr_10.42.42.2(pid=19027): stderr: | [0;m[1;31m20221214115959474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214115959474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214115959474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214115959474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214115959474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214115959474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214115959486 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214115959495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214115959495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214115959495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:02.909869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19026): Terminating (SIGTERM) 12:00:02.951881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19029): Terminating (SIGTERM) 12:00:02.994429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19032): Terminating (SIGTERM) 12:00:03.036441 --- ParallelTerminationStrategy: PID 19026 died... 12:00:03.056445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19026): Terminated: ok {rc=0} 12:00:03.102985 --- ParallelTerminationStrategy: PID 19029 died... 12:00:03.122729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19029): Terminated: ok {rc=0} 12:00:03.168650 --- ParallelTerminationStrategy: PID 19032 died... 12:00:03.188362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19032): Terminated: ok {rc=0} 12:00:03.275805 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:00:04.363197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:04.375557 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:00:04.453449 tst ping_idle_ping.py: using LAC 40748 12:00:04.579966 tst ping_idle_ping.py: using RAC 203 12:00:04.704343 tst ping_idle_ping.py: using CellId 40748 12:00:04.829203 tst ping_idle_ping.py: using BVCI 40749 12:00:04.946615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:04.958303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:04.969772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:04.981095 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:04.992786 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:05.004700 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:05.016685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:05.028556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:00:05.147161 tst ping_idle_ping.py:24: start network... 12:00:05.349278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:05.824895 run create_hlr_db(pid=19057): Launched 12:00:05.941746 bus /gobi_6: Setting Powered False 12:00:07.002391 run create_hlr_db(pid=19057): Terminated: ok {rc=0} 12:00:07.426802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19059): Launched 12:00:07.730335 run osmo-hlr_10.42.42.2(pid=19060): Launched 12:00:07.881102 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:08.442455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19063): Launched 12:00:08.765588 run osmo-stp_10.42.42.5(pid=19064): Launched 12:00:08.889461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:09.445872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19066): Launched 12:00:09.570416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:09.843164 run patchelf(pid=19067): Launched 12:00:10.023878 run osmo-stp_10.42.42.5(pid=19064): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19064)] 12:00:10.161410 run osmo-stp_10.42.42.5(pid=19064): stdout: | (launched: 2022-12-14_12:00:08.706008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:10.299964 run osmo-stp_10.42.42.5(pid=19064): stderr: | [0;m[38;5;43m20221214120008897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120008897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120008897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120008898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120008898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120008898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120008898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:10.439367 run osmo-stp_10.42.42.5(pid=19064): stdout: | (launched: 2022-12-14_12:00:08.706008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:10.571607 run osmo-stp_10.42.42.5(pid=19064): stderr: | [0;m[38;5;43m20221214120008897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120008897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120008897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120008898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120008898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120008898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120008898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:10.728398 run patchelf(pid=19067): Terminating (SIGINT) 12:00:10.909272 run patchelf(pid=19067): Terminated: ok {rc=0} 12:00:11.039642 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19064): Process ended prematurely: osmo-stp_10.42.42.5(pid=19064) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19064)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:00:11.049411 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:00:11.077539 run osmo-hlr_10.42.42.2(pid=19060): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19060)] 12:00:11.127825 run osmo-hlr_10.42.42.2(pid=19060): stdout: | (launched: 2022-12-14_12:00:07.674184) 12:00:11.179958 run osmo-hlr_10.42.42.2(pid=19060): stderr: | [0;m[1;31m20221214120007853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120007853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120007853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120007853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120007853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120007853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120007871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120007882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120007882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120007882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:11.232252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19059): Terminating (SIGTERM) 12:00:11.274399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19063): Terminating (SIGTERM) 12:00:11.316549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19066): Terminating (SIGTERM) 12:00:11.358775 --- ParallelTerminationStrategy: PID 19059 died... 12:00:11.378844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19059): Terminated: ok {rc=0} 12:00:11.425466 --- ParallelTerminationStrategy: PID 19063 died... 12:00:11.445221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19063): Terminated: ok {rc=0} 12:00:11.491309 --- ParallelTerminationStrategy: PID 19066 died... 12:00:11.510898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19066): Terminated: ok {rc=0} 12:00:11.599435 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:00:12.914011 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:12.920540 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:00:12.958783 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:00:12.997472 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:00:13.085598 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:00:13.120350 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:00:13.158438 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:00:13.751355 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:00:13.800830 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:13.811932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:00:13.882823 tst cs_paging_gprs_active.py: using LAC 40749 12:00:14.003640 tst cs_paging_gprs_active.py: using RAC 204 12:00:14.124910 tst cs_paging_gprs_active.py: using CellId 40749 12:00:14.244482 tst cs_paging_gprs_active.py: using BVCI 40750 12:00:14.355893 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:14.366929 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:14.377818 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:14.388711 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:14.399870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:14.411152 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:14.422444 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:14.433568 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:14.444748 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:14.566992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:14.686946 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:00:14.892914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:15.202173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19074): Launched 12:00:15.473690 run iperf3-srv_10.42.42.10(pid=19075): Launched 12:00:15.607938 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:00:15.830436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:16.170721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19076): Launched 12:00:16.473455 run iperf3-srv_10.42.42.10(pid=19077): Launched 12:00:16.612376 tst cs_paging_gprs_active.py:38: start network... 12:00:16.857054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:17.384733 run create_hlr_db(pid=19078): Launched 12:00:17.520188 bus /gobi_6: Setting Powered False 12:00:18.585198 run create_hlr_db(pid=19078): Terminated: ok {rc=0} 12:00:19.042574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19080): Launched 12:00:19.371054 run osmo-hlr_10.42.42.2(pid=19081): Launched 12:00:19.497857 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:20.062530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19083): Launched 12:00:20.392703 run osmo-stp_10.42.42.5(pid=19084): Launched 12:00:20.516349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:21.081520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19086): Launched 12:00:21.206771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:21.484562 run patchelf(pid=19087): Launched 12:00:21.667794 run osmo-stp_10.42.42.5(pid=19084): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19084)] 12:00:21.806459 run osmo-stp_10.42.42.5(pid=19084): stdout: | (launched: 2022-12-14_12:00:20.332241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:21.947425 run osmo-stp_10.42.42.5(pid=19084): stderr: | [0;m[38;5;43m20221214120020523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120020523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120020524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120020524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120020525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120020525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120020525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:22.088089 run osmo-stp_10.42.42.5(pid=19084): stdout: | (launched: 2022-12-14_12:00:20.332241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:22.222764 run osmo-stp_10.42.42.5(pid=19084): stderr: | [0;m[38;5;43m20221214120020523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120020523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120020524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120020524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120020525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120020525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120020525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:22.381929 run patchelf(pid=19087): Terminating (SIGINT) 12:00:22.565818 run patchelf(pid=19087): Terminated: ok {rc=0} 12:00:22.698457 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19084): Process ended prematurely: osmo-stp_10.42.42.5(pid=19084) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19084)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:00:22.708706 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:00:22.737458 run osmo-hlr_10.42.42.2(pid=19081): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19081)] 12:00:22.787832 run osmo-hlr_10.42.42.2(pid=19081): stdout: | (launched: 2022-12-14_12:00:19.310633) 12:00:22.839796 run osmo-hlr_10.42.42.2(pid=19081): stderr: | [0;m[1;31m20221214120019506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120019506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120019506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120019506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120019506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120019506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120019557 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120019568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120019568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120019568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:22.892199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19074): Terminating (SIGTERM) 12:00:22.934818 run iperf3-srv_10.42.42.10(pid=19075): Terminating (SIGTERM) 12:00:22.977312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19076): Terminating (SIGTERM) 12:00:23.019085 run iperf3-srv_10.42.42.10(pid=19077): Terminating (SIGTERM) 12:00:23.060699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19080): Terminating (SIGTERM) 12:00:23.102571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19083): Terminating (SIGTERM) 12:00:23.144385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19086): Terminating (SIGTERM) 12:00:23.186960 --- ParallelTerminationStrategy: PID 19074 died... 12:00:23.207042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19074): Terminated: ok {rc=0} 12:00:23.253206 --- ParallelTerminationStrategy: PID 19075 died... 12:00:23.272613 run iperf3-srv_10.42.42.10(pid=19075): Terminated {rc=256} 12:00:23.318617 --- ParallelTerminationStrategy: PID 19076 died... 12:00:23.338268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19076): Terminated: ok {rc=0} 12:00:23.384189 --- ParallelTerminationStrategy: PID 19077 died... 12:00:23.403787 run iperf3-srv_10.42.42.10(pid=19077): Terminated {rc=256} 12:00:23.449703 --- ParallelTerminationStrategy: PID 19080 died... 12:00:23.469097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19080): Terminated: ok {rc=0} 12:00:23.514981 --- ParallelTerminationStrategy: PID 19083 died... 12:00:23.534556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19083): Terminated: ok {rc=0} 12:00:23.580480 --- ParallelTerminationStrategy: PID 19086 died... 12:00:23.600107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19086): Terminated: ok {rc=0} 12:00:23.687611 bus /gobi_0: Setting Powered False 12:00:24.787233 bus /gobi_0: Setting Powered False 12:00:25.902648 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:00:27.051520 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:27.063910 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:00:27.140133 tst iperf3.py: using LAC 40750 12:00:27.265141 tst iperf3.py: using RAC 205 12:00:27.384697 tst iperf3.py: using CellId 40750 12:00:27.503552 tst iperf3.py: using BVCI 40751 12:00:27.624512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:27.636338 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:27.648161 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:27.659518 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:27.671053 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:27.682558 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:27.693984 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:27.705291 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:27.716613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:27.838019 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:00:28.059525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:28.390468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19088): Launched 12:00:28.679639 run iperf3-srv_10.42.42.10(pid=19089): Launched 12:00:28.804328 tst iperf3.py:8: start network... 12:00:29.025450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:29.534471 run create_hlr_db(pid=19090): Launched 12:00:29.667320 bus /gobi_6: Setting Powered False 12:00:30.731324 run create_hlr_db(pid=19090): Terminated: ok {rc=0} 12:00:31.197163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19092): Launched 12:00:31.549682 run osmo-hlr_10.42.42.2(pid=19093): Launched 12:00:31.744687 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:32.431795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19095): Launched 12:00:32.744249 run osmo-stp_10.42.42.5(pid=19096): Launched 12:00:32.861450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:33.388615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19098): Launched 12:00:33.506175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:33.764721 run patchelf(pid=19099): Launched 12:00:33.934480 run osmo-stp_10.42.42.5(pid=19096): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19096)] 12:00:34.064389 run osmo-stp_10.42.42.5(pid=19096): stdout: | (launched: 2022-12-14_12:00:32.687407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:34.195768 run osmo-stp_10.42.42.5(pid=19096): stderr: | [0;m[38;5;43m20221214120032856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120032856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120032856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120032857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120032857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120032857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120032857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:34.327243 run osmo-stp_10.42.42.5(pid=19096): stdout: | (launched: 2022-12-14_12:00:32.687407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:34.452704 run osmo-stp_10.42.42.5(pid=19096): stderr: | [0;m[38;5;43m20221214120032856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120032856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120032856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120032857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120032857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120032857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120032857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:34.601650 run patchelf(pid=19099): Terminating (SIGINT) 12:00:34.773920 run patchelf(pid=19099): Terminated: ok {rc=0} 12:00:34.898419 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19096): Process ended prematurely: osmo-stp_10.42.42.5(pid=19096) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19096)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 12:00:34.907839 tst iperf3.py:8: Test FAILED (7.9 sec) 12:00:34.935508 run osmo-hlr_10.42.42.2(pid=19093): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19093)] 12:00:34.983882 run osmo-hlr_10.42.42.2(pid=19093): stdout: | (launched: 2022-12-14_12:00:31.480601) 12:00:35.033508 run osmo-hlr_10.42.42.2(pid=19093): stderr: | [0;m[1;31m20221214120031769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120031769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120031769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120031769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120031769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120031769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120031786 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120031800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120031800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120031800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:35.083568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19088): Terminating (SIGTERM) 12:00:35.123803 run iperf3-srv_10.42.42.10(pid=19089): Terminating (SIGTERM) 12:00:35.163696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19092): Terminating (SIGTERM) 12:00:35.203798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19095): Terminating (SIGTERM) 12:00:35.243669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19098): Terminating (SIGTERM) 12:00:35.283854 --- ParallelTerminationStrategy: PID 19088 died... 12:00:35.303376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19088): Terminated: ok {rc=0} 12:00:35.347554 --- ParallelTerminationStrategy: PID 19089 died... 12:00:35.366387 run iperf3-srv_10.42.42.10(pid=19089): Terminated {rc=256} 12:00:35.410725 --- ParallelTerminationStrategy: PID 19092 died... 12:00:35.429690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19092): Terminated: ok {rc=0} 12:00:35.473853 --- ParallelTerminationStrategy: PID 19095 died... 12:00:35.492931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19095): Terminated: ok {rc=0} 12:00:35.537219 --- ParallelTerminationStrategy: PID 19098 died... 12:00:35.556168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19098): Terminated: ok {rc=0} 12:00:35.643466 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:00:36.794541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:36.806343 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:00:36.877355 tst iperf3m4.py: using LAC 40751 12:00:36.999057 tst iperf3m4.py: using RAC 206 12:00:37.121140 tst iperf3m4.py: using CellId 40751 12:00:37.241330 tst iperf3m4.py: using BVCI 40752 12:00:37.352103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:37.363187 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:37.374170 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:37.385222 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:37.396333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:37.407560 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:37.418948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:37.430063 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:37.441631 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:37.564728 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:37.686033 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:37.808071 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:37.926202 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:00:38.133051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:38.442501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19101): Launched 12:00:38.712783 run iperf3-srv_10.42.42.10(pid=19102): Launched 12:00:38.828038 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:00:39.033734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:39.342025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19103): Launched 12:00:39.611357 run iperf3-srv_10.42.42.10(pid=19104): Launched 12:00:39.725799 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:00:39.930357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:40.238521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19105): Launched 12:00:40.508542 run iperf3-srv_10.42.42.10(pid=19106): Launched 12:00:40.623706 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:00:40.828257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:41.136441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19107): Launched 12:00:41.403846 run iperf3-srv_10.42.42.10(pid=19108): Launched 12:00:41.519779 tst iperf3m4.py:8: start network... 12:00:41.723885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:42.241229 run create_hlr_db(pid=19109): Launched 12:00:42.363049 bus /gobi_6: Setting Powered False 12:00:43.427514 run create_hlr_db(pid=19109): Terminated: ok {rc=0} 12:00:43.866814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19111): Launched 12:00:44.173661 run osmo-hlr_10.42.42.2(pid=19112): Launched 12:00:44.290015 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:44.834177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19114): Launched 12:00:45.140719 run osmo-stp_10.42.42.5(pid=19115): Launched 12:00:45.256461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:45.783172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19117): Launched 12:00:45.928687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:46.193954 run patchelf(pid=19118): Launched 12:00:46.382463 run osmo-stp_10.42.42.5(pid=19115): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19115)] 12:00:46.516391 run osmo-stp_10.42.42.5(pid=19115): stdout: | (launched: 2022-12-14_12:00:45.083109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:46.651724 run osmo-stp_10.42.42.5(pid=19115): stderr: | [0;m[38;5;43m20221214120045253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120045253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120045253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120045254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120045254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120045254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120045254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:46.787477 run osmo-stp_10.42.42.5(pid=19115): stdout: | (launched: 2022-12-14_12:00:45.083109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:46.917311 run osmo-stp_10.42.42.5(pid=19115): stderr: | [0;m[38;5;43m20221214120045253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120045253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120045253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120045254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120045254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120045254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120045254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:47.084845 run patchelf(pid=19118): Terminating (SIGINT) 12:00:47.275915 run patchelf(pid=19118): Terminated: ok {rc=0} 12:00:47.409540 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19115): Process ended prematurely: osmo-stp_10.42.42.5(pid=19115) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19115)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:00:47.420251 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:00:47.449591 run osmo-hlr_10.42.42.2(pid=19112): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19112)] 12:00:47.500014 run osmo-hlr_10.42.42.2(pid=19112): stdout: | (launched: 2022-12-14_12:00:44.116639) 12:00:47.552189 run osmo-hlr_10.42.42.2(pid=19112): stderr: | [0;m[1;31m20221214120044289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120044289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120044289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120044290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120044290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120044290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120044302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120044311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120044311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120044311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:47.604508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19101): Terminating (SIGTERM) 12:00:47.646738 run iperf3-srv_10.42.42.10(pid=19102): Terminating (SIGTERM) 12:00:47.688615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19103): Terminating (SIGTERM) 12:00:47.731101 run iperf3-srv_10.42.42.10(pid=19104): Terminating (SIGTERM) 12:00:47.774486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19105): Terminating (SIGTERM) 12:00:47.816817 run iperf3-srv_10.42.42.10(pid=19106): Terminating (SIGTERM) 12:00:47.858805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19107): Terminating (SIGTERM) 12:00:47.901335 run iperf3-srv_10.42.42.10(pid=19108): Terminating (SIGTERM) 12:00:47.943792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19111): Terminating (SIGTERM) 12:00:47.985792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19114): Terminating (SIGTERM) 12:00:48.028248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19117): Terminating (SIGTERM) 12:00:48.070695 --- ParallelTerminationStrategy: PID 19101 died... 12:00:48.090943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19101): Terminated: ok {rc=0} 12:00:48.137836 --- ParallelTerminationStrategy: PID 19102 died... 12:00:48.157842 run iperf3-srv_10.42.42.10(pid=19102): Terminated {rc=256} 12:00:48.204374 --- ParallelTerminationStrategy: PID 19103 died... 12:00:48.224249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19103): Terminated: ok {rc=0} 12:00:48.270876 --- ParallelTerminationStrategy: PID 19104 died... 12:00:48.290600 run iperf3-srv_10.42.42.10(pid=19104): Terminated {rc=256} 12:00:48.337073 --- ParallelTerminationStrategy: PID 19105 died... 12:00:48.356699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19105): Terminated: ok {rc=0} 12:00:48.404455 --- ParallelTerminationStrategy: PID 19106 died... 12:00:48.424376 run iperf3-srv_10.42.42.10(pid=19106): Terminated {rc=256} 12:00:48.470992 --- ParallelTerminationStrategy: PID 19107 died... 12:00:48.491294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19107): Terminated: ok {rc=0} 12:00:48.538139 --- ParallelTerminationStrategy: PID 19108 died... 12:00:48.558074 run iperf3-srv_10.42.42.10(pid=19108): Terminated {rc=256} 12:00:48.604708 --- ParallelTerminationStrategy: PID 19111 died... 12:00:48.624820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19111): Terminated: ok {rc=0} 12:00:48.671547 --- ParallelTerminationStrategy: PID 19114 died... 12:00:48.691337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19114): Terminated: ok {rc=0} 12:00:48.737985 --- ParallelTerminationStrategy: PID 19117 died... 12:00:48.758318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19117): Terminated: ok {rc=0} 12:00:48.847529 bus /gobi_4: Setting Powered False 12:00:49.948638 bus /gobi_4: Setting Powered False 12:00:51.068097 bus /gobi_1: Setting Powered False 12:00:52.166966 bus /gobi_1: Setting Powered False 12:00:53.284705 bus /gobi_0: Setting Powered False 12:00:54.384164 bus /gobi_0: Setting Powered False 12:00:55.501521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:00:56.604577 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:56.616398 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:00:56.688142 tst ping.py: using LAC 40752 12:00:56.805961 tst ping.py: using RAC 207 12:00:56.929763 tst ping.py: using CellId 40752 12:00:57.057174 tst ping.py: using BVCI 40753 12:00:57.174275 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:57.185955 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:57.197347 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:57.208941 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:57.220261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:57.231664 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:57.243114 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:57.254493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:57.370594 tst ping.py:19: start network... 12:00:57.572424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:58.038153 run create_hlr_db(pid=19122): Launched 12:00:58.154347 bus /gobi_6: Setting Powered False 12:00:59.215210 run create_hlr_db(pid=19122): Terminated: ok {rc=0} 12:00:59.657952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19124): Launched 12:00:59.980919 run osmo-hlr_10.42.42.2(pid=19125): Launched 12:01:00.104173 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:00.668622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19127): Launched 12:01:01.022094 run osmo-stp_10.42.42.5(pid=19128): Launched 12:01:01.303424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:01:01.868912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19130): Launched 12:01:02.005676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:01:02.284695 run patchelf(pid=19131): Launched 12:01:02.464828 run osmo-stp_10.42.42.5(pid=19128): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19128)] 12:01:02.601531 run osmo-stp_10.42.42.5(pid=19128): stdout: | (launched: 2022-12-14_12:01:00.960230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:02.740125 run osmo-stp_10.42.42.5(pid=19128): stderr: | [0;m[38;5;43m20221214120101156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120101156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120101157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120101157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120101158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120101158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120101158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:02.878770 run osmo-stp_10.42.42.5(pid=19128): stdout: | (launched: 2022-12-14_12:01:00.960230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:03.010234 run osmo-stp_10.42.42.5(pid=19128): stderr: | [0;m[38;5;43m20221214120101156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120101156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120101157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120101157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120101158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120101158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120101158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:03.166715 run patchelf(pid=19131): Terminating (SIGINT) 12:01:03.347080 run patchelf(pid=19131): Terminated: ok {rc=0} 12:01:03.477605 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19128): Process ended prematurely: osmo-stp_10.42.42.5(pid=19128) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19128)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 12:01:03.487222 tst ping.py:22: Test FAILED (6.9 sec) 12:01:03.515252 run osmo-hlr_10.42.42.2(pid=19125): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19125)] 12:01:03.565438 run osmo-hlr_10.42.42.2(pid=19125): stdout: | (launched: 2022-12-14_12:00:59.921210) 12:01:03.617332 run osmo-hlr_10.42.42.2(pid=19125): stderr: | [0;m[1;31m20221214120100120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120100120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120100120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120100120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120100120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120100120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120100132 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120100142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120100142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120100142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:03.669612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19124): Terminating (SIGTERM) 12:01:03.712103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19127): Terminating (SIGTERM) 12:01:03.754897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19130): Terminating (SIGTERM) 12:01:03.797452 --- ParallelTerminationStrategy: PID 19124 died... 12:01:03.817702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19124): Terminated: ok {rc=0} 12:01:03.864377 --- ParallelTerminationStrategy: PID 19127 died... 12:01:03.884109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19127): Terminated: ok {rc=0} 12:01:03.930317 --- ParallelTerminationStrategy: PID 19130 died... 12:01:03.950111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19130): Terminated: ok {rc=0} 12:01:04.038936 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:01:05.125671 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:05.140511 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:01:05.213250 tst ping_idle_ping.py: using LAC 40753 12:01:05.339589 tst ping_idle_ping.py: using RAC 208 12:01:05.465026 tst ping_idle_ping.py: using CellId 40753 12:01:05.590550 tst ping_idle_ping.py: using BVCI 40754 12:01:05.707743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:05.719305 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:05.730733 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:05.742179 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:05.753481 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:05.764817 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:05.776296 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:05.787705 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:01:05.903230 tst ping_idle_ping.py:24: start network... 12:01:06.106045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:06.576551 run create_hlr_db(pid=19132): Launched 12:01:06.709201 bus /gobi_6: Setting Powered False 12:01:07.772890 run create_hlr_db(pid=19132): Terminated: ok {rc=0} 12:01:08.226013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19134): Launched 12:01:08.550284 run osmo-hlr_10.42.42.2(pid=19135): Launched 12:01:08.674000 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:09.235325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19137): Launched 12:01:09.561096 run osmo-stp_10.42.42.5(pid=19138): Launched 12:01:09.685306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:01:10.246611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19140): Launched 12:01:10.370403 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:01:10.645371 run patchelf(pid=19141): Launched 12:01:10.826662 run osmo-stp_10.42.42.5(pid=19138): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19138)] 12:01:10.963615 run osmo-stp_10.42.42.5(pid=19138): stdout: | (launched: 2022-12-14_12:01:09.500782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:11.103220 run osmo-stp_10.42.42.5(pid=19138): stderr: | [0;m[38;5;43m20221214120109695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120109695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120109695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120109695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120109696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120109696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120109696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:11.242642 run osmo-stp_10.42.42.5(pid=19138): stdout: | (launched: 2022-12-14_12:01:09.500782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:11.375128 run osmo-stp_10.42.42.5(pid=19138): stderr: | [0;m[38;5;43m20221214120109695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120109695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120109695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120109695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120109696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120109696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120109696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:11.532848 run patchelf(pid=19141): Terminating (SIGINT) 12:01:11.714371 run patchelf(pid=19141): Terminated: ok {rc=0} 12:01:11.845088 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19138): Process ended prematurely: osmo-stp_10.42.42.5(pid=19138) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19138)] [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:01:11.854834 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:01:11.882981 run osmo-hlr_10.42.42.2(pid=19135): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19135)] 12:01:11.933148 run osmo-hlr_10.42.42.2(pid=19135): stdout: | (launched: 2022-12-14_12:01:08.490197) 12:01:11.984860 run osmo-hlr_10.42.42.2(pid=19135): stderr: | [0;m[1;31m20221214120108689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120108689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120108689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120108689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120108689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120108689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120108702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120108710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120108710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120108710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:12.037116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19134): Terminating (SIGTERM) 12:01:12.078959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19137): Terminating (SIGTERM) 12:01:12.121532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19140): Terminating (SIGTERM) 12:01:12.164140 --- ParallelTerminationStrategy: PID 19134 died... 12:01:12.184250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19134): Terminated: ok {rc=0} 12:01:12.230473 --- ParallelTerminationStrategy: PID 19137 died... 12:01:12.250086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19137): Terminated: ok {rc=0} 12:01:12.295857 --- ParallelTerminationStrategy: PID 19140 died... 12:01:12.315295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19140): Terminated: ok {rc=0} 12:01:12.403402 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:01:13.717365 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:13.725049 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:01:13.759433 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:01:13.795277 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:01:13.851551 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:01:13.885981 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:01:13.920923 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:01:14.476204 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:01:14.481697 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:01:14.493109 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:01:14.565433 tst switch_tch_pdch.py: using LAC 40754 12:01:14.693190 tst switch_tch_pdch.py: using RAC 209 12:01:14.818306 tst switch_tch_pdch.py: using CellId 40754 12:01:14.943899 tst switch_tch_pdch.py: using BVCI 40755 12:01:15.060653 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:01:15.072501 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:01:15.084239 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:01:15.095942 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:01:15.107674 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:01:15.119450 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:01:15.131321 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:01:15.143060 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:01:15.260549 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:01:15.382842 tst switch_tch_pdch.py:51: start network... 12:01:15.601172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:16.105343 run create_hlr_db(pid=19145): Launched 12:01:16.239513 bus /gobi_6: Setting Powered False 12:01:17.305923 run create_hlr_db(pid=19145): Terminated: ok {rc=0} 12:01:17.759137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19147): Launched 12:01:18.083094 run osmo-hlr_10.42.42.2(pid=19148): Launched 12:01:18.205933 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:18.758243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19150): Launched 12:01:19.079698 run osmo-stp_10.42.42.5(pid=19151): Launched 12:01:19.202990 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:01:19.758179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19153): Launched 12:01:19.882460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:01:20.154235 run patchelf(pid=19154): Launched 12:01:20.332541 run osmo-stp_10.42.42.5(pid=19151): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19151)] 12:01:20.468754 run osmo-stp_10.42.42.5(pid=19151): stdout: | (launched: 2022-12-14_12:01:19.020004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:20.606550 run osmo-stp_10.42.42.5(pid=19151): stderr: | [0;m[38;5;43m20221214120119213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120119213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120119214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120119214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120119214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120119214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120119214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:20.744221 run osmo-stp_10.42.42.5(pid=19151): stdout: | (launched: 2022-12-14_12:01:19.020004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:20.874966 run osmo-stp_10.42.42.5(pid=19151): stderr: | [0;m[38;5;43m20221214120119213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120119213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120119214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120119214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120119214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120119214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120119214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:21.030213 run patchelf(pid=19154): Terminating (SIGINT) 12:01:21.209966 run patchelf(pid=19154): Terminated: ok {rc=0} 12:01:21.339238 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19151): Process ended prematurely: osmo-stp_10.42.42.5(pid=19151) [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19151)] [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:01:21.348806 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 12:01:21.376616 run osmo-hlr_10.42.42.2(pid=19148): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19148)] 12:01:21.426697 run osmo-hlr_10.42.42.2(pid=19148): stdout: | (launched: 2022-12-14_12:01:18.023110) 12:01:21.478136 run osmo-hlr_10.42.42.2(pid=19148): stderr: | [0;m[1;31m20221214120118223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120118223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120118223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120118223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120118223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120118223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120118235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120118243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120118243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120118244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:21.530173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19147): Terminating (SIGTERM) 12:01:21.571878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19150): Terminating (SIGTERM) 12:01:21.613797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19153): Terminating (SIGTERM) 12:01:21.656155 --- ParallelTerminationStrategy: PID 19147 died... 12:01:21.675999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19147): Terminated: ok {rc=0} 12:01:21.722445 --- ParallelTerminationStrategy: PID 19150 died... 12:01:21.741926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19150): Terminated: ok {rc=0} 12:01:21.787569 --- ParallelTerminationStrategy: PID 19153 died... 12:01:21.807001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19153): Terminated: ok {rc=0} 12:01:21.894784 bus /gobi_0: Setting Powered False 12:01:22.993588 bus /gobi_0: Setting Powered False 12:01:24.109851 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:01:25.372111 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:25.378383 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:01:25.412699 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:01:25.448360 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:01:25.502416 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:01:25.535674 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:01:25.570001 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:01:26.131338 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:01:26.136895 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:01:26.148858 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:01:26.219497 tst switch_tch_pdch.py: using LAC 40755 12:01:26.344590 tst switch_tch_pdch.py: using RAC 210 12:01:26.469018 tst switch_tch_pdch.py: using CellId 40755 12:01:26.593601 tst switch_tch_pdch.py: using BVCI 40756 12:01:26.703856 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:01:26.715136 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:01:26.726441 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:01:26.737514 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:01:26.748702 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:01:26.760071 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:01:26.771334 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:01:26.782753 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:01:26.900551 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:01:27.020667 tst switch_tch_pdch.py:51: start network... 12:01:27.238783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:27.711427 run create_hlr_db(pid=19158): Launched 12:01:27.843383 bus /gobi_6: Setting Powered False 12:01:28.907243 run create_hlr_db(pid=19158): Terminated: ok {rc=0} 12:01:29.314426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19160): Launched 12:01:29.615843 run osmo-hlr_10.42.42.2(pid=19161): Launched 12:01:29.730484 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:30.222105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19163): Launched 12:01:30.523536 run osmo-stp_10.42.42.5(pid=19164): Launched 12:01:30.637091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:01:31.174275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19166): Launched 12:01:31.311642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:01:31.591699 run patchelf(pid=19167): Launched 12:01:31.774903 run osmo-stp_10.42.42.5(pid=19164): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19164)] 12:01:31.915374 run osmo-stp_10.42.42.5(pid=19164): stdout: | (launched: 2022-12-14_12:01:30.467366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:32.057538 run osmo-stp_10.42.42.5(pid=19164): stderr: | [0;m[38;5;43m20221214120130639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120130639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120130639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120130639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120130640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120130640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120130640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:32.198128 run osmo-stp_10.42.42.5(pid=19164): stdout: | (launched: 2022-12-14_12:01:30.467366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:32.330120 run osmo-stp_10.42.42.5(pid=19164): stderr: | [0;m[38;5;43m20221214120130639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120130639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120130639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120130639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120130640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120130640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120130640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:32.487421 run patchelf(pid=19167): Terminating (SIGINT) 12:01:32.668510 run patchelf(pid=19167): Terminated: ok {rc=0} 12:01:32.798996 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19164): Process ended prematurely: osmo-stp_10.42.42.5(pid=19164) [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19164)] [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:01:32.808618 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:01:32.836859 run osmo-hlr_10.42.42.2(pid=19161): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19161)] 12:01:32.887196 run osmo-hlr_10.42.42.2(pid=19161): stdout: | (launched: 2022-12-14_12:01:29.559347) 12:01:32.939227 run osmo-hlr_10.42.42.2(pid=19161): stderr: | [0;m[1;31m20221214120129737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120129737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120129737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120129737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120129737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120129737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120129749 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120129758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120129758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120129758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:32.991674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19160): Terminating (SIGTERM) 12:01:33.033967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19163): Terminating (SIGTERM) 12:01:33.076773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19166): Terminating (SIGTERM) 12:01:33.119475 --- ParallelTerminationStrategy: PID 19160 died... 12:01:33.139747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19160): Terminated: ok {rc=0} 12:01:33.186293 --- ParallelTerminationStrategy: PID 19163 died... 12:01:33.205963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19163): Terminated: ok {rc=0} 12:01:33.252027 --- ParallelTerminationStrategy: PID 19166 died... 12:01:33.271824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19166): Terminated: ok {rc=0} 12:01:33.360374 bus /gobi_0: Setting Powered False 12:01:34.459595 bus /gobi_0: Setting Powered False 12:01:35.575854 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_sms:trx-umtrx --------------------------------------------------------------------- 12:01:36.831408 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:36.836399 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:01:36.870408 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 12:01:36.877479 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 12:01:36.928917 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:01:36.962172 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 12:01:36.969113 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 12:01:37.510569 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 12:01:37.515959 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 12:01:37.528016 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 12:01:37.576066 tst mo_mt_sms.py: using LAC 40756 12:01:37.700132 tst mo_mt_sms.py: using RAC 211 12:01:37.823826 tst mo_mt_sms.py: using CellId 40756 12:01:37.949781 tst mo_mt_sms.py: using BVCI 40757 12:01:38.067372 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 12:01:38.184463 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 12:01:38.298605 tst mo_mt_sms.py:9: start nitb and bts... 12:01:38.502130 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:01:39.115699 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19171): Launched 12:01:39.418425 run osmo-nitb_10.42.42.2(pid=19172): Launched 12:01:39.586881 run osmo-nitb_10.42.42.2(pid=19172): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19172)] 12:01:39.722931 run osmo-nitb_10.42.42.2(pid=19172): stdout: | (launched: 2022-12-14_12:01:39.362220) 12:01:39.860152 run osmo-nitb_10.42.42.2(pid=19172): stderr: | (launched: 2022-12-14_12:01:39.406824) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:01:40.004373 run osmo-nitb_10.42.42.2(pid=19172): stdout: | (launched: 2022-12-14_12:01:39.362220) 12:01:40.145243 run osmo-nitb_10.42.42.2(pid=19172): stderr: | (launched: 2022-12-14_12:01:39.406824) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19172): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19172) [trial-2404↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19172)] 12:01:40.534218 tst osmo-nitb_10.42.42.2(pid=19172): stdout: | (launched: 2022-12-14_12:01:39.362220) 12:01:40.664894 tst osmo-nitb_10.42.42.2(pid=19172): stderr: | (launched: 2022-12-14_12:01:39.406824) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:01:40.818344 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19172): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19172) [trial-2404↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19172)] [trial-2404↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 12:01:40.827522 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 12:01:40.834532 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19171): Terminating (SIGTERM) 12:01:41.045094 --- ParallelTerminationStrategy: PID 19171 died... 12:01:41.066451 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19171): Terminated: ok {rc=0} 12:01:41.155338 bus /sierra_3: Setting Powered False 12:01:42.254810 bus /sierra_3: Setting Powered False 12:01:43.373326 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 sms:trx-umtrx --------------------------------------------------------------------- 12:01:44.575895 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:44.580931 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:01:44.613272 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:01:44.641097 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 12:01:44.692652 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:01:44.725048 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:01:44.751721 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 12:01:45.298050 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 12:01:45.303261 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:01:45.313998 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 12:01:45.360522 tst mo_mt_sms.py: using LAC 40757 12:01:45.478617 tst mo_mt_sms.py: using RAC 212 12:01:45.600805 tst mo_mt_sms.py: using CellId 40757 12:01:45.718701 tst mo_mt_sms.py: using BVCI 40758 12:01:45.827541 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:01:45.850614 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:01:45.862972 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:01:45.875938 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:01:45.891244 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:01:45.904118 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 12:01:46.035610 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 12:01:46.150548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:46.628637 run create_hlr_db(pid=19176): Launched 12:01:46.748231 bus /sierra_2: Setting Powered False 12:01:47.808498 run create_hlr_db(pid=19176): Terminated: ok {rc=0} 12:01:48.230752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19178): Launched 12:01:48.531509 run osmo-hlr_10.42.42.2(pid=19179): Launched 12:01:48.644136 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:49.173641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19181): Launched 12:01:49.475842 run osmo-stp_10.42.42.5(pid=19182): Launched 12:01:49.589936 run osmo-msc_10.42.42.6: Starting osmo-msc 12:01:50.132153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19184): Launched 12:01:50.434205 run osmo-msc_10.42.42.6(pid=19185): Launched 12:01:50.603120 run osmo-stp_10.42.42.5(pid=19182): ERR: Terminated: ERROR {rc=1} [trial-2404↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19182)] 12:01:50.730950 run osmo-stp_10.42.42.5(pid=19182): stdout: | (launched: 2022-12-14_12:01:49.419152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:50.858380 run osmo-stp_10.42.42.5(pid=19182): stderr: | [0;m[38;5;43m20221214120149591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120149591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120149591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120149592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120149592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120149592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120149592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:50.983221 run osmo-stp_10.42.42.5(pid=19182): stdout: | (launched: 2022-12-14_12:01:49.419152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:51.102794 run osmo-stp_10.42.42.5(pid=19182): stderr: | [0;m[38;5;43m20221214120149591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120149591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120149591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120149592 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120149592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120149592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120149592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:51.245663 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19182): Process ended prematurely: osmo-stp_10.42.42.5(pid=19182) [trial-2404↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19182)] [trial-2404↪sms:trx-umtrx↪mo_mt_sms.py:16] 12:01:51.253954 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 12:01:51.280010 run osmo-hlr_10.42.42.2(pid=19179): ERR: Terminated: ERROR {rc=237} [trial-2404↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19179)] 12:01:51.328462 run osmo-hlr_10.42.42.2(pid=19179): stdout: | (launched: 2022-12-14_12:01:48.475600) 12:01:51.378331 run osmo-hlr_10.42.42.2(pid=19179): stderr: | [0;m[1;31m20221214120148649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120148650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120148650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120148650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120148650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120148650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120148662 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120148671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120148671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120148671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:51.448560 run osmo-msc_10.42.42.6(pid=19185): ERR: Terminated: ERROR {rc=2} [trial-2404↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19185)] 12:01:51.496258 run osmo-msc_10.42.42.6(pid=19185): stdout: | (launched: 2022-12-14_12:01:50.377404) 12:01:51.545876 run osmo-msc_10.42.42.6(pid=19185): stderr: | [0;m[38;5;43m20221214120150647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120150647 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f799055cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120150647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120150647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120150647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120150647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120150649 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120150649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120150650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120150650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:01:51.595993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19178): Terminating (SIGTERM) 12:01:51.636027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19181): Terminating (SIGTERM) 12:01:51.676074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19184): Terminating (SIGTERM) 12:01:51.716399 --- ParallelTerminationStrategy: PID 19178 died... 12:01:51.735814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19178): Terminated: ok {rc=0} 12:01:51.779839 --- ParallelTerminationStrategy: PID 19181 died... 12:01:51.798651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19181): Terminated: ok {rc=0} 12:01:51.842888 --- ParallelTerminationStrategy: PID 19184 died... 12:01:51.861942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19184): Terminated: ok {rc=0} 12:01:51.948102 bus /sierra_3: Setting Powered False 12:01:53.048313 bus /sierra_3: Setting Powered False 12:01:54.165708 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 12:01:55.401697 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:55.406029 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:01:55.439727 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 12:01:55.447205 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 12:01:55.483100 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:01:55.516447 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 12:01:55.523437 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 12:01:56.043172 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 12:01:56.048317 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 12:01:56.059492 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 12:01:56.108109 tst assert_extension.py: using LAC 40758 12:01:56.234328 tst assert_extension.py: using RAC 213 12:01:56.361386 tst assert_extension.py: using CellId 40758 12:01:56.486543 tst assert_extension.py: using BVCI 40759 12:01:56.602840 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 12:01:56.721440 tst assert_extension.py:10: start nitb and bts... 12:01:56.938356 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:01:57.596468 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19190): Launched 12:01:57.920285 run osmo-nitb_10.42.42.2(pid=19191): Launched 12:01:58.099313 run osmo-nitb_10.42.42.2(pid=19191): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19191)] 12:01:58.243145 run osmo-nitb_10.42.42.2(pid=19191): stdout: | (launched: 2022-12-14_12:01:57.860482) 12:01:58.388458 run osmo-nitb_10.42.42.2(pid=19191): stderr: | (launched: 2022-12-14_12:01:57.908224) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:01:58.534669 run osmo-nitb_10.42.42.2(pid=19191): stdout: | (launched: 2022-12-14_12:01:57.860482) 12:01:58.674331 run osmo-nitb_10.42.42.2(pid=19191): stderr: | (launched: 2022-12-14_12:01:57.908224) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19191): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19191) [trial-2404↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19191)] 12:01:59.042629 tst osmo-nitb_10.42.42.2(pid=19191): stdout: | (launched: 2022-12-14_12:01:57.860482) 12:01:59.172652 tst osmo-nitb_10.42.42.2(pid=19191): stderr: | (launched: 2022-12-14_12:01:57.908224) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:01:59.326078 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19191): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19191) [trial-2404↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19191)] [trial-2404↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 12:01:59.335495 tst assert_extension.py:12: Test FAILED (3.3 sec) 12:01:59.342919 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19190): Terminating (SIGTERM) 12:01:59.553914 --- ParallelTerminationStrategy: PID 19190 died... 12:01:59.576176 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19190): Terminated: ok {rc=0} 12:01:59.664914 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 ussd:trx-umtrx --------------------------------------------------------------------- 12:02:00.848785 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:00.858926 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:02:00.895087 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:02:00.924665 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 12:02:00.966894 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:02:01.011174 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:02:01.039013 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 12:02:01.568795 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 12:02:01.574992 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:02:01.587079 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 12:02:01.638872 tst assert_extension.py: using LAC 40759 12:02:01.799873 tst assert_extension.py: using RAC 214 12:02:01.922720 tst assert_extension.py: using CellId 40759 12:02:02.043704 tst assert_extension.py: using BVCI 40760 12:02:02.155147 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:02:02.166693 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:02:02.178216 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:02:02.189885 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:02:02.202137 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:02:02.214297 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 12:02:02.336895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:02.803254 run create_hlr_db(pid=19195): Launched 12:02:02.918771 bus /sierra_2: Setting Powered False 12:02:03.978690 run create_hlr_db(pid=19195): Terminated: ok {rc=0} 12:02:04.421274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19197): Launched 12:02:04.745735 run osmo-hlr_10.42.42.2(pid=19198): Launched 12:02:04.869738 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:05.433700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19200): Launched 12:02:05.756233 run osmo-stp_10.42.42.5(pid=19201): Launched 12:02:05.879501 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:06.461045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19203): Launched 12:02:06.782751 run osmo-msc_10.42.42.6(pid=19204): Launched 12:02:06.962016 run osmo-stp_10.42.42.5(pid=19201): ERR: Terminated: ERROR {rc=1} [trial-2404↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19201)] 12:02:07.096503 run osmo-stp_10.42.42.5(pid=19201): stdout: | (launched: 2022-12-14_12:02:05.696517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:07.231982 run osmo-stp_10.42.42.5(pid=19201): stderr: | [0;m[38;5;43m20221214120205887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120205887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120205887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120205888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120205888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120205888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120205889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:07.366553 run osmo-stp_10.42.42.5(pid=19201): stdout: | (launched: 2022-12-14_12:02:05.696517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:07.494354 run osmo-stp_10.42.42.5(pid=19201): stderr: | [0;m[38;5;43m20221214120205887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120205887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120205887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120205888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120205888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120205888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120205889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:07.648239 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19201): Process ended prematurely: osmo-stp_10.42.42.5(pid=19201) [trial-2404↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19201)] [trial-2404↪ussd:trx-umtrx↪assert_extension.py:17] 12:02:07.657529 tst assert_extension.py:17: Test FAILED (6.1 sec) 12:02:07.685068 run osmo-hlr_10.42.42.2(pid=19198): ERR: Terminated: ERROR {rc=237} [trial-2404↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19198)] 12:02:07.735187 run osmo-hlr_10.42.42.2(pid=19198): stdout: | (launched: 2022-12-14_12:02:04.686050) 12:02:07.786696 run osmo-hlr_10.42.42.2(pid=19198): stderr: | [0;m[1;31m20221214120204883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120204883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120204883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120204883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120204883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120204883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120204898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120204906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120204906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120204906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:07.858410 run osmo-msc_10.42.42.6(pid=19204): ERR: Terminated: ERROR {rc=2} [trial-2404↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19204)] 12:02:07.907872 run osmo-msc_10.42.42.6(pid=19204): stdout: | (launched: 2022-12-14_12:02:06.723007) 12:02:07.959227 run osmo-msc_10.42.42.6(pid=19204): stderr: | [0;m[38;5;43m20221214120207043 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120207043 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a68f8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120207043 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120207043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120207043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120207043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120207045 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120207046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120207046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120207046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:08.010874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19197): Terminating (SIGTERM) 12:02:08.052642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19200): Terminating (SIGTERM) 12:02:08.094414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19203): Terminating (SIGTERM) 12:02:08.136344 --- ParallelTerminationStrategy: PID 19197 died... 12:02:08.156526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19197): Terminated: ok {rc=0} 12:02:08.203374 --- ParallelTerminationStrategy: PID 19200 died... 12:02:08.223164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19200): Terminated: ok {rc=0} 12:02:08.269380 --- ParallelTerminationStrategy: PID 19203 died... 12:02:08.289141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19203): Terminated: ok {rc=0} 12:02:08.378049 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:02:09.591202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:09.598585 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:02:09.631658 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:02:09.660204 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:02:09.714817 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:02:09.748166 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:02:09.776371 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:02:10.323114 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:02:10.374392 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:10.385635 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:02:10.454083 tst mo_mt_call.py: using LAC 40760 12:02:10.575065 tst mo_mt_call.py: using RAC 215 12:02:10.698367 tst mo_mt_call.py: using CellId 40760 12:02:10.819298 tst mo_mt_call.py: using BVCI 40761 12:02:10.931696 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:10.942808 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:10.953762 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:10.964688 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:10.976070 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:10.987318 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:02:11.109562 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:02:11.229124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:11.705368 run create_hlr_db(pid=19209): Launched 12:02:11.821793 bus /sierra_2: Setting Powered False 12:02:12.882769 run create_hlr_db(pid=19209): Terminated: ok {rc=0} 12:02:13.310803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19211): Launched 12:02:13.621667 run osmo-hlr_10.42.42.2(pid=19212): Launched 12:02:13.749487 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:14.319295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19214): Launched 12:02:14.629646 run osmo-stp_10.42.42.5(pid=19215): Launched 12:02:14.746523 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:15.301896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19217): Launched 12:02:15.610671 run osmo-msc_10.42.42.6(pid=19218): Launched 12:02:15.781227 run osmo-stp_10.42.42.5(pid=19215): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19215)] 12:02:15.945273 run osmo-stp_10.42.42.5(pid=19215): stdout: | (launched: 2022-12-14_12:02:14.572646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:16.169466 run osmo-stp_10.42.42.5(pid=19215): stderr: | [0;m[38;5;43m20221214120214746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120214746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120214746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120214747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120214747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120214747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120214747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:16.304583 run osmo-stp_10.42.42.5(pid=19215): stdout: | (launched: 2022-12-14_12:02:14.572646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:16.430031 run osmo-stp_10.42.42.5(pid=19215): stderr: | [0;m[38;5;43m20221214120214746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120214746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120214746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120214747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120214747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120214747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120214747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:16.580246 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19215): Process ended prematurely: osmo-stp_10.42.42.5(pid=19215) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19215)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:02:16.590621 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:02:16.618286 run osmo-hlr_10.42.42.2(pid=19212): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19212)] 12:02:16.671000 run osmo-hlr_10.42.42.2(pid=19212): stdout: | (launched: 2022-12-14_12:02:13.560480) 12:02:16.721881 run osmo-hlr_10.42.42.2(pid=19212): stderr: | [0;m[1;31m20221214120213761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120213761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120213761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120213761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120213761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120213761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120213773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120213781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120213782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120213782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:16.795044 run osmo-msc_10.42.42.6(pid=19218): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19218)] 12:02:16.844443 run osmo-msc_10.42.42.6(pid=19218): stdout: | (launched: 2022-12-14_12:02:15.553246) 12:02:16.897666 run osmo-msc_10.42.42.6(pid=19218): stderr: | [0;m[38;5;43m20221214120215822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120215822 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e2a331c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120215822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120215823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120215823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120215823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120215825 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120215825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120215825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120215825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:16.950182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19211): Terminating (SIGTERM) 12:02:16.991625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19214): Terminating (SIGTERM) 12:02:17.034651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19217): Terminating (SIGTERM) 12:02:17.079292 --- ParallelTerminationStrategy: PID 19211 died... 12:02:17.100566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19211): Terminated: ok {rc=0} 12:02:17.148493 --- ParallelTerminationStrategy: PID 19214 died... 12:02:17.169413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19214): Terminated: ok {rc=0} 12:02:17.216237 --- ParallelTerminationStrategy: PID 19217 died... 12:02:17.237138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19217): Terminated: ok {rc=0} 12:02:17.326281 bus /sierra_3: Setting Powered False 12:02:18.425049 bus /sierra_3: Setting Powered False 12:02:19.541498 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:02:20.691084 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:20.703286 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:02:20.777350 tst mo_mt_call_osmux.py: using LAC 40761 12:02:20.905917 tst mo_mt_call_osmux.py: using RAC 216 12:02:21.033169 tst mo_mt_call_osmux.py: using CellId 40761 12:02:21.159523 tst mo_mt_call_osmux.py: using BVCI 40762 12:02:21.272019 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:21.283236 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:21.294368 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:21.305549 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:21.316732 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:02:21.330720 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:02:21.452194 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:02:21.571816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:22.046516 run create_hlr_db(pid=19220): Launched 12:02:22.164128 bus /sierra_2: Setting Powered False 12:02:23.224222 run create_hlr_db(pid=19220): Terminated: ok {rc=0} 12:02:23.673314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19222): Launched 12:02:24.002457 run osmo-hlr_10.42.42.2(pid=19223): Launched 12:02:24.128163 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:24.697039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19225): Launched 12:02:25.026297 run osmo-stp_10.42.42.5(pid=19226): Launched 12:02:25.152866 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:25.748092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19228): Launched 12:02:26.078529 run osmo-msc_10.42.42.6(pid=19229): Launched 12:02:26.261641 run osmo-stp_10.42.42.5(pid=19226): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19226)] 12:02:26.399537 run osmo-stp_10.42.42.5(pid=19226): stdout: | (launched: 2022-12-14_12:02:24.965668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:26.539247 run osmo-stp_10.42.42.5(pid=19226): stderr: | [0;m[38;5;43m20221214120225158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120225158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120225158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120225159 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120225159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120225159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120225159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:26.676133 run osmo-stp_10.42.42.5(pid=19226): stdout: | (launched: 2022-12-14_12:02:24.965668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:26.806400 run osmo-stp_10.42.42.5(pid=19226): stderr: | [0;m[38;5;43m20221214120225158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120225158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120225158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120225159 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120225159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120225159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120225159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:26.962311 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19226): Process ended prematurely: osmo-stp_10.42.42.5(pid=19226) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19226)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:02:26.972091 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:02:27.000169 run osmo-hlr_10.42.42.2(pid=19223): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19223)] 12:02:27.050699 run osmo-hlr_10.42.42.2(pid=19223): stdout: | (launched: 2022-12-14_12:02:23.941813) 12:02:27.102872 run osmo-hlr_10.42.42.2(pid=19223): stderr: | [0;m[1;31m20221214120224141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120224141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120224141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120224141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120224141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120224141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120224152 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120224161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120224161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120224161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:27.175662 run osmo-msc_10.42.42.6(pid=19229): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19229)] 12:02:27.225984 run osmo-msc_10.42.42.6(pid=19229): stdout: | (launched: 2022-12-14_12:02:26.017437) 12:02:27.277846 run osmo-msc_10.42.42.6(pid=19229): stderr: | [0;m[38;5;43m20221214120226341 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120226341 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1fb9834c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120226341 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120226341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120226341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120226342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120226343 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120226344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120226344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120226344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:27.329970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19222): Terminating (SIGTERM) 12:02:27.371820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19225): Terminating (SIGTERM) 12:02:27.414302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19228): Terminating (SIGTERM) 12:02:27.456787 --- ParallelTerminationStrategy: PID 19222 died... 12:02:27.476910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19222): Terminated: ok {rc=0} 12:02:27.523585 --- ParallelTerminationStrategy: PID 19225 died... 12:02:27.543330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19225): Terminated: ok {rc=0} 12:02:27.589597 --- ParallelTerminationStrategy: PID 19228 died... 12:02:27.609331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19228): Terminated: ok {rc=0} 12:02:27.697826 bus /sierra_3: Setting Powered False 12:02:28.796608 bus /sierra_3: Setting Powered False 12:02:29.913343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:02:31.209244 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:31.219211 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:02:31.253530 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:02:31.282116 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:02:31.337210 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:02:31.371406 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:02:31.400234 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:02:31.968044 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:02:32.036561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:32.051878 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:02:32.132053 tst mo_mt_call.py: using LAC 40762 12:02:32.262911 tst mo_mt_call.py: using RAC 217 12:02:32.391226 tst mo_mt_call.py: using CellId 40762 12:02:32.523282 tst mo_mt_call.py: using BVCI 40763 12:02:32.643685 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:32.655582 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:32.667010 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:32.678575 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:32.690608 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:32.702630 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:02:32.821250 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:02:32.942330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:33.453588 run create_hlr_db(pid=19235): Launched 12:02:33.587706 bus /sierra_2: Setting Powered False 12:02:34.652138 run create_hlr_db(pid=19235): Terminated: ok {rc=0} 12:02:35.090854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19237): Launched 12:02:35.400451 run osmo-hlr_10.42.42.2(pid=19238): Launched 12:02:35.517554 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:36.058049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19240): Launched 12:02:36.367644 run osmo-stp_10.42.42.5(pid=19241): Launched 12:02:36.484683 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:37.044624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19243): Launched 12:02:37.352473 run osmo-msc_10.42.42.6(pid=19244): Launched 12:02:37.526411 run osmo-stp_10.42.42.5(pid=19241): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19241)] 12:02:37.656538 run osmo-stp_10.42.42.5(pid=19241): stdout: | (launched: 2022-12-14_12:02:36.310371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:37.787114 run osmo-stp_10.42.42.5(pid=19241): stderr: | [0;m[38;5;43m20221214120236481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120236481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120236481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120236481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120236482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120236482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120236482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:37.915702 run osmo-stp_10.42.42.5(pid=19241): stdout: | (launched: 2022-12-14_12:02:36.310371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:38.037472 run osmo-stp_10.42.42.5(pid=19241): stderr: | [0;m[38;5;43m20221214120236481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120236481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120236481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120236481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120236482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120236482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120236482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:38.183794 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19241): Process ended prematurely: osmo-stp_10.42.42.5(pid=19241) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19241)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:02:38.192743 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:02:38.219511 run osmo-hlr_10.42.42.2(pid=19238): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19238)] 12:02:38.268350 run osmo-hlr_10.42.42.2(pid=19238): stdout: | (launched: 2022-12-14_12:02:35.343347) 12:02:38.318566 run osmo-hlr_10.42.42.2(pid=19238): stderr: | [0;m[1;31m20221214120235522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120235522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120235522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120235523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120235523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120235523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120235535 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120235543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120235544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120235544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:38.389011 run osmo-msc_10.42.42.6(pid=19244): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19244)] 12:02:38.437313 run osmo-msc_10.42.42.6(pid=19244): stdout: | (launched: 2022-12-14_12:02:37.295382) 12:02:38.487659 run osmo-msc_10.42.42.6(pid=19244): stderr: | [0;m[38;5;43m20221214120237565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120237565 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2848233c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120237565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120237565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120237565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120237566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120237567 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120237568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120237568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120237568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:38.538547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19237): Terminating (SIGTERM) 12:02:38.579246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19240): Terminating (SIGTERM) 12:02:38.619739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19243): Terminating (SIGTERM) 12:02:38.660422 --- ParallelTerminationStrategy: PID 19237 died... 12:02:38.680166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19237): Terminated: ok {rc=0} 12:02:38.725602 --- ParallelTerminationStrategy: PID 19240 died... 12:02:38.744784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19240): Terminated: ok {rc=0} 12:02:38.789619 --- ParallelTerminationStrategy: PID 19243 died... 12:02:38.808905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19243): Terminated: ok {rc=0} 12:02:38.896323 bus /sierra_3: Setting Powered False 12:02:39.996528 bus /sierra_3: Setting Powered False 12:02:41.111419 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:02:42.261791 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:42.274192 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:02:42.345757 tst mo_mt_call_osmux.py: using LAC 40763 12:02:42.475436 tst mo_mt_call_osmux.py: using RAC 218 12:02:42.605376 tst mo_mt_call_osmux.py: using CellId 40763 12:02:42.733280 tst mo_mt_call_osmux.py: using BVCI 40764 12:02:42.851896 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:42.863604 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:42.875123 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:42.886624 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:42.898221 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:02:42.909724 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:02:43.027533 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:02:43.154140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:43.664011 run create_hlr_db(pid=19246): Launched 12:02:43.798410 bus /sierra_2: Setting Powered False 12:02:44.862481 run create_hlr_db(pid=19246): Terminated: ok {rc=0} 12:02:45.300692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19248): Launched 12:02:45.607613 run osmo-hlr_10.42.42.2(pid=19249): Launched 12:02:45.726629 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:46.349860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19251): Launched 12:02:46.695737 run osmo-stp_10.42.42.5(pid=19252): Launched 12:02:46.984120 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:47.596272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19254): Launched 12:02:47.928656 run osmo-msc_10.42.42.6(pid=19255): Launched 12:02:48.111442 run osmo-stp_10.42.42.5(pid=19252): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19252)] 12:02:48.249179 run osmo-stp_10.42.42.5(pid=19252): stdout: | (launched: 2022-12-14_12:02:46.634541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:48.387330 run osmo-stp_10.42.42.5(pid=19252): stderr: | [0;m[38;5;43m20221214120246866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120246866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120246866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120246867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120246867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120246867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120246867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:48.525574 run osmo-stp_10.42.42.5(pid=19252): stdout: | (launched: 2022-12-14_12:02:46.634541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:48.655918 run osmo-stp_10.42.42.5(pid=19252): stderr: | [0;m[38;5;43m20221214120246866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120246866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120246866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120246867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120246867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120246867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120246867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:48.812129 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19252): Process ended prematurely: osmo-stp_10.42.42.5(pid=19252) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19252)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:02:48.822060 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:02:48.849882 run osmo-hlr_10.42.42.2(pid=19249): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19249)] 12:02:48.900024 run osmo-hlr_10.42.42.2(pid=19249): stdout: | (launched: 2022-12-14_12:02:45.550513) 12:02:48.951651 run osmo-hlr_10.42.42.2(pid=19249): stderr: | [0;m[1;31m20221214120245730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120245730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120245730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120245730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120245730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120245730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120245743 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120245753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120245753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120245753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:49.024229 run osmo-msc_10.42.42.6(pid=19255): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19255)] 12:02:49.074234 run osmo-msc_10.42.42.6(pid=19255): stdout: | (launched: 2022-12-14_12:02:47.867041) 12:02:49.125876 run osmo-msc_10.42.42.6(pid=19255): stderr: | [0;m[38;5;43m20221214120248189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120248189 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2e9fd00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120248189 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120248189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120248189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120248189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120248191 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120248191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120248191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120248192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:02:49.177969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19248): Terminating (SIGTERM) 12:02:49.219982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19251): Terminating (SIGTERM) 12:02:49.262635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19254): Terminating (SIGTERM) 12:02:49.305152 --- ParallelTerminationStrategy: PID 19248 died... 12:02:49.325262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19248): Terminated: ok {rc=0} 12:02:49.371407 --- ParallelTerminationStrategy: PID 19251 died... 12:02:49.391005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19251): Terminated: ok {rc=0} 12:02:49.436701 --- ParallelTerminationStrategy: PID 19254 died... 12:02:49.456193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19254): Terminated: ok {rc=0} 12:02:49.544030 bus /sierra_3: Setting Powered False 12:02:50.642711 bus /sierra_3: Setting Powered False 12:02:51.758764 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:02:53.012650 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:53.019717 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:02:53.052774 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:02:53.080379 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:02:53.136075 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:02:53.169451 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:02:53.196768 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:02:53.746713 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:02:53.799177 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:53.810707 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:02:53.879965 tst mo_mt_call.py: using LAC 40764 12:02:54.009100 tst mo_mt_call.py: using RAC 219 12:02:54.130751 tst mo_mt_call.py: using CellId 40764 12:02:54.252738 tst mo_mt_call.py: using BVCI 40765 12:02:54.365895 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:54.377180 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:54.388164 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:54.399253 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:54.410618 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:02:54.421889 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:02:54.543825 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:02:54.661662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:55.135786 run create_hlr_db(pid=19261): Launched 12:02:55.252262 bus /sierra_2: Setting Powered False 12:02:56.313611 run create_hlr_db(pid=19261): Terminated: ok {rc=0} 12:02:56.773387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19263): Launched 12:02:57.102948 run osmo-hlr_10.42.42.2(pid=19264): Launched 12:02:57.230349 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:57.795862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19266): Launched 12:02:58.126967 run osmo-stp_10.42.42.5(pid=19267): Launched 12:02:58.253671 run osmo-msc_10.42.42.6: Starting osmo-msc 12:02:58.850514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19269): Launched 12:02:59.180809 run osmo-msc_10.42.42.6(pid=19270): Launched 12:02:59.364911 run osmo-stp_10.42.42.5(pid=19267): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19267)] 12:02:59.504022 run osmo-stp_10.42.42.5(pid=19267): stdout: | (launched: 2022-12-14_12:02:58.066065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:59.643456 run osmo-stp_10.42.42.5(pid=19267): stderr: | [0;m[38;5;43m20221214120258258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120258258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120258258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120258258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120258259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120258259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120258259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:59.781390 run osmo-stp_10.42.42.5(pid=19267): stdout: | (launched: 2022-12-14_12:02:58.066065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:59.911865 run osmo-stp_10.42.42.5(pid=19267): stderr: | [0;m[38;5;43m20221214120258258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120258258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120258258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120258258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120258259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120258259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120258259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:00.068909 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19267): Process ended prematurely: osmo-stp_10.42.42.5(pid=19267) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19267)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:03:00.078744 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:03:00.106824 run osmo-hlr_10.42.42.2(pid=19264): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19264)] 12:03:00.157542 run osmo-hlr_10.42.42.2(pid=19264): stdout: | (launched: 2022-12-14_12:02:57.042034) 12:03:00.210129 run osmo-hlr_10.42.42.2(pid=19264): stderr: | [0;m[1;31m20221214120257241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120257241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120257241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120257241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120257241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120257241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120257253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120257262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120257262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120257262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:00.283561 run osmo-msc_10.42.42.6(pid=19270): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19270)] 12:03:00.334360 run osmo-msc_10.42.42.6(pid=19270): stdout: | (launched: 2022-12-14_12:02:59.119572) 12:03:00.386612 run osmo-msc_10.42.42.6(pid=19270): stderr: | [0;m[38;5;43m20221214120259441 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120259441 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5f1e98ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120259441 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120259441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120259442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120259442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120259443 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120259444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120259444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120259444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:00.439100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19263): Terminating (SIGTERM) 12:03:00.481725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19266): Terminating (SIGTERM) 12:03:00.523937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19269): Terminating (SIGTERM) 12:03:00.566402 --- ParallelTerminationStrategy: PID 19263 died... 12:03:00.586774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19263): Terminated: ok {rc=0} 12:03:00.633570 --- ParallelTerminationStrategy: PID 19266 died... 12:03:00.653358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19266): Terminated: ok {rc=0} 12:03:00.700166 --- ParallelTerminationStrategy: PID 19269 died... 12:03:00.719960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19269): Terminated: ok {rc=0} 12:03:00.808415 bus /sierra_3: Setting Powered False 12:03:01.911198 bus /sierra_3: Setting Powered False 12:03:03.032376 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:03:04.183757 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:03:04.196047 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:03:04.267990 tst mo_mt_call_osmux.py: using LAC 40765 12:03:04.397556 tst mo_mt_call_osmux.py: using RAC 220 12:03:04.518580 tst mo_mt_call_osmux.py: using CellId 40765 12:03:04.639757 tst mo_mt_call_osmux.py: using BVCI 40766 12:03:04.752253 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:03:04.763475 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:03:04.774926 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:03:04.786060 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:03:04.797509 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:03:04.808740 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:03:04.926206 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:03:05.047923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:05.559206 run create_hlr_db(pid=19273): Launched 12:03:05.692671 bus /sierra_2: Setting Powered False 12:03:06.758019 run create_hlr_db(pid=19273): Terminated: ok {rc=0} 12:03:07.198063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19275): Launched 12:03:07.506913 run osmo-hlr_10.42.42.2(pid=19276): Launched 12:03:07.624275 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:08.167363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19278): Launched 12:03:08.477543 run osmo-stp_10.42.42.5(pid=19279): Launched 12:03:08.596928 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:09.153710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19281): Launched 12:03:09.463275 run osmo-msc_10.42.42.6(pid=19282): Launched 12:03:09.634679 run osmo-stp_10.42.42.5(pid=19279): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19279)] 12:03:09.764534 run osmo-stp_10.42.42.5(pid=19279): stdout: | (launched: 2022-12-14_12:03:08.419941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:09.894334 run osmo-stp_10.42.42.5(pid=19279): stderr: | [0;m[38;5;43m20221214120308590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120308590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120308591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120308591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120308591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120308592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120308592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:10.022421 run osmo-stp_10.42.42.5(pid=19279): stdout: | (launched: 2022-12-14_12:03:08.419941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:10.144581 run osmo-stp_10.42.42.5(pid=19279): stderr: | [0;m[38;5;43m20221214120308590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120308590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120308591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120308591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120308591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120308592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120308592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:10.290694 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19279): Process ended prematurely: osmo-stp_10.42.42.5(pid=19279) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19279)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:03:10.299818 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:03:10.326496 run osmo-hlr_10.42.42.2(pid=19276): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19276)] 12:03:10.375417 run osmo-hlr_10.42.42.2(pid=19276): stdout: | (launched: 2022-12-14_12:03:07.448674) 12:03:10.425742 run osmo-hlr_10.42.42.2(pid=19276): stderr: | [0;m[1;31m20221214120307626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120307626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120307626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120307626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120307626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120307626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120307638 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120307646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120307646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120307646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:10.495960 run osmo-msc_10.42.42.6(pid=19282): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19282)] 12:03:10.544248 run osmo-msc_10.42.42.6(pid=19282): stdout: | (launched: 2022-12-14_12:03:09.405358) 12:03:10.594256 run osmo-msc_10.42.42.6(pid=19282): stderr: | [0;m[38;5;43m20221214120309675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120309675 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f57ccfcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120309675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120309675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120309675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120309676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120309677 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120309678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120309678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120309678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:10.644622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19275): Terminating (SIGTERM) 12:03:10.685303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19278): Terminating (SIGTERM) 12:03:10.725926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19281): Terminating (SIGTERM) 12:03:10.767002 --- ParallelTerminationStrategy: PID 19275 died... 12:03:10.786887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19275): Terminated: ok {rc=0} 12:03:10.831650 --- ParallelTerminationStrategy: PID 19278 died... 12:03:10.850880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19278): Terminated: ok {rc=0} 12:03:10.895243 --- ParallelTerminationStrategy: PID 19281 died... 12:03:10.914476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19281): Terminated: ok {rc=0} 12:03:10.998972 bus /sierra_3: Setting Powered False 12:03:12.097314 bus /sierra_3: Setting Powered False 12:03:13.217207 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:03:14.462647 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:14.469188 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:03:14.501073 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:03:14.528756 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:03:14.580516 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:03:14.614227 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:03:14.642872 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:03:15.193945 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:03:15.246097 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:15.257268 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:03:15.325384 tst mo_mt_call.py: using LAC 40766 12:03:15.459327 tst mo_mt_call.py: using RAC 221 12:03:15.589441 tst mo_mt_call.py: using CellId 40766 12:03:15.717275 tst mo_mt_call.py: using BVCI 40767 12:03:15.836777 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:15.851146 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:15.863204 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:15.875536 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:15.888291 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:15.902306 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:03:16.041919 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:03:16.178187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:16.698369 run create_hlr_db(pid=19287): Launched 12:03:16.866064 bus /sierra_2: Setting Powered False 12:03:17.930620 run create_hlr_db(pid=19287): Terminated: ok {rc=0} 12:03:18.391350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19289): Launched 12:03:18.722253 run osmo-hlr_10.42.42.2(pid=19290): Launched 12:03:18.846133 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:19.415810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19292): Launched 12:03:19.747315 run osmo-stp_10.42.42.5(pid=19293): Launched 12:03:19.873871 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:20.470774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19295): Launched 12:03:20.800830 run osmo-msc_10.42.42.6(pid=19296): Launched 12:03:20.985223 run osmo-stp_10.42.42.5(pid=19293): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19293)] 12:03:21.123890 run osmo-stp_10.42.42.5(pid=19293): stdout: | (launched: 2022-12-14_12:03:19.686533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:21.262973 run osmo-stp_10.42.42.5(pid=19293): stderr: | [0;m[38;5;43m20221214120319879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120319879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120319880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120319880 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120319881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120319881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120319881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:21.400237 run osmo-stp_10.42.42.5(pid=19293): stdout: | (launched: 2022-12-14_12:03:19.686533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:21.531104 run osmo-stp_10.42.42.5(pid=19293): stderr: | [0;m[38;5;43m20221214120319879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120319879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120319880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120319880 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120319881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120319881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120319881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:21.687174 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19293): Process ended prematurely: osmo-stp_10.42.42.5(pid=19293) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19293)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:03:21.696604 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:03:21.724647 run osmo-hlr_10.42.42.2(pid=19290): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19290)] 12:03:21.775590 run osmo-hlr_10.42.42.2(pid=19290): stdout: | (launched: 2022-12-14_12:03:18.660580) 12:03:21.828292 run osmo-hlr_10.42.42.2(pid=19290): stderr: | [0;m[1;31m20221214120318861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120318861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120318861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120318861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120318861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120318861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120318873 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120318882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120318882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120318882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:21.901493 run osmo-msc_10.42.42.6(pid=19296): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19296)] 12:03:21.952141 run osmo-msc_10.42.42.6(pid=19296): stdout: | (launched: 2022-12-14_12:03:20.739805) 12:03:22.004600 run osmo-msc_10.42.42.6(pid=19296): stderr: | [0;m[38;5;43m20221214120321060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120321060 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa64deddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120321060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120321060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120321061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120321061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120321062 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120321063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120321063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120321063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:22.057524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19289): Terminating (SIGTERM) 12:03:22.099586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19292): Terminating (SIGTERM) 12:03:22.142611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19295): Terminating (SIGTERM) 12:03:22.185068 --- ParallelTerminationStrategy: PID 19289 died... 12:03:22.205288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19289): Terminated: ok {rc=0} 12:03:22.251438 --- ParallelTerminationStrategy: PID 19292 died... 12:03:22.271120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19292): Terminated: ok {rc=0} 12:03:22.317181 --- ParallelTerminationStrategy: PID 19295 died... 12:03:22.336650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19295): Terminated: ok {rc=0} 12:03:22.423677 bus /sierra_3: Setting Powered False 12:03:23.524136 bus /sierra_3: Setting Powered False 12:03:24.643494 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:03:25.790635 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:25.802589 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:03:25.870601 tst mo_mt_call_osmux.py: using LAC 40767 12:03:25.991448 tst mo_mt_call_osmux.py: using RAC 222 12:03:26.112874 tst mo_mt_call_osmux.py: using CellId 40767 12:03:26.233761 tst mo_mt_call_osmux.py: using BVCI 40768 12:03:26.346068 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:26.357164 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:26.368213 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:26.379271 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:26.390694 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:03:26.402107 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:03:26.518437 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:03:26.635371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:27.111812 run create_hlr_db(pid=19298): Launched 12:03:27.228020 bus /sierra_2: Setting Powered False 12:03:28.288208 run create_hlr_db(pid=19298): Terminated: ok {rc=0} 12:03:28.738032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19300): Launched 12:03:29.067147 run osmo-hlr_10.42.42.2(pid=19301): Launched 12:03:29.195006 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:29.764006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19303): Launched 12:03:30.092082 run osmo-stp_10.42.42.5(pid=19304): Launched 12:03:30.218639 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:30.811674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19306): Launched 12:03:31.173704 run osmo-msc_10.42.42.6(pid=19307): Launched 12:03:31.515869 run osmo-stp_10.42.42.5(pid=19304): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19304)] 12:03:31.837443 run osmo-stp_10.42.42.5(pid=19304): stdout: | (launched: 2022-12-14_12:03:30.031125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:32.017083 run osmo-stp_10.42.42.5(pid=19304): stderr: | [0;m[38;5;43m20221214120330226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120330226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120330226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120330227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120330227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120330227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120330227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:32.150959 run osmo-stp_10.42.42.5(pid=19304): stdout: | (launched: 2022-12-14_12:03:30.031125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:32.276789 run osmo-stp_10.42.42.5(pid=19304): stderr: | [0;m[38;5;43m20221214120330226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120330226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120330226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120330227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120330227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120330227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120330227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:32.423029 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19304): Process ended prematurely: osmo-stp_10.42.42.5(pid=19304) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19304)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:03:32.432336 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 12:03:32.459324 run osmo-hlr_10.42.42.2(pid=19301): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19301)] 12:03:32.508572 run osmo-hlr_10.42.42.2(pid=19301): stdout: | (launched: 2022-12-14_12:03:29.006331) 12:03:32.559583 run osmo-hlr_10.42.42.2(pid=19301): stderr: | [0;m[1;31m20221214120329207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120329207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120329207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120329207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120329207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120329207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120329220 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120329228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120329228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120329228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:32.629136 run osmo-msc_10.42.42.6(pid=19307): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19307)] 12:03:32.677081 run osmo-msc_10.42.42.6(pid=19307): stdout: | (launched: 2022-12-14_12:03:31.110932) 12:03:32.726787 run osmo-msc_10.42.42.6(pid=19307): stderr: | [0;m[38;5;43m20221214120331681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120331681 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2e023ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120331681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120331681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120331681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120331682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120331683 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120331684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120331684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120331684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:32.776642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19300): Terminating (SIGTERM) 12:03:32.816851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19303): Terminating (SIGTERM) 12:03:32.857148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19306): Terminating (SIGTERM) 12:03:32.897553 --- ParallelTerminationStrategy: PID 19300 died... 12:03:32.917384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19300): Terminated: ok {rc=0} 12:03:32.961991 --- ParallelTerminationStrategy: PID 19303 died... 12:03:32.980897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19303): Terminated: ok {rc=0} 12:03:33.025375 --- ParallelTerminationStrategy: PID 19306 died... 12:03:33.044612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19306): Terminated: ok {rc=0} 12:03:33.131555 bus /sierra_3: Setting Powered False 12:03:34.229857 bus /sierra_3: Setting Powered False 12:03:35.343607 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:03:36.590895 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:36.597426 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:03:36.629326 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:03:36.656648 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:03:36.708083 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:03:36.740414 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:03:36.767249 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:03:37.317466 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:03:37.367542 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:37.378902 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:03:37.447500 tst mo_mt_call.py: using LAC 40768 12:03:37.567730 tst mo_mt_call.py: using RAC 223 12:03:37.689240 tst mo_mt_call.py: using CellId 40768 12:03:37.811543 tst mo_mt_call.py: using BVCI 40769 12:03:37.924737 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:37.935999 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:37.947118 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:37.958273 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:37.969943 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:37.981438 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:03:38.103058 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:03:38.221023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:38.696456 run create_hlr_db(pid=19312): Launched 12:03:38.815552 bus /sierra_2: Setting Powered False 12:03:39.877612 run create_hlr_db(pid=19312): Terminated: ok {rc=0} 12:03:40.308339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19314): Launched 12:03:40.618641 run osmo-hlr_10.42.42.2(pid=19315): Launched 12:03:40.735968 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:41.278116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19317): Launched 12:03:41.587414 run osmo-stp_10.42.42.5(pid=19318): Launched 12:03:41.706145 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:42.260598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19320): Launched 12:03:42.569654 run osmo-msc_10.42.42.6(pid=19321): Launched 12:03:42.742148 run osmo-stp_10.42.42.5(pid=19318): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19318)] 12:03:42.871724 run osmo-stp_10.42.42.5(pid=19318): stdout: | (launched: 2022-12-14_12:03:41.530253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:43.002013 run osmo-stp_10.42.42.5(pid=19318): stderr: | [0;m[38;5;43m20221214120341701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120341701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120341701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120341702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120341702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120341702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120341702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:43.130309 run osmo-stp_10.42.42.5(pid=19318): stdout: | (launched: 2022-12-14_12:03:41.530253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:43.252003 run osmo-stp_10.42.42.5(pid=19318): stderr: | [0;m[38;5;43m20221214120341701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120341701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120341701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120341702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120341702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120341702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120341702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:43.397837 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19318): Process ended prematurely: osmo-stp_10.42.42.5(pid=19318) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19318)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:03:43.406869 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:03:43.433413 run osmo-hlr_10.42.42.2(pid=19315): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19315)] 12:03:43.482233 run osmo-hlr_10.42.42.2(pid=19315): stdout: | (launched: 2022-12-14_12:03:40.561243) 12:03:43.532169 run osmo-hlr_10.42.42.2(pid=19315): stderr: | [0;m[1;31m20221214120340736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120340737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120340737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120340737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120340737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120340737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120340748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120340756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120340756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120340756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:43.601644 run osmo-msc_10.42.42.6(pid=19321): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19321)] 12:03:43.649885 run osmo-msc_10.42.42.6(pid=19321): stdout: | (launched: 2022-12-14_12:03:42.512381) 12:03:43.699781 run osmo-msc_10.42.42.6(pid=19321): stderr: | [0;m[38;5;43m20221214120342780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120342780 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdf813b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120342780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120342780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120342780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120342781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120342782 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120342783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120342783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120342783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:43.749853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19314): Terminating (SIGTERM) 12:03:43.790354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19317): Terminating (SIGTERM) 12:03:43.830735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19320): Terminating (SIGTERM) 12:03:43.871810 --- ParallelTerminationStrategy: PID 19314 died... 12:03:43.891398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19314): Terminated: ok {rc=0} 12:03:43.935832 --- ParallelTerminationStrategy: PID 19317 died... 12:03:43.955106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19317): Terminated: ok {rc=0} 12:03:43.999670 --- ParallelTerminationStrategy: PID 19320 died... 12:03:44.018948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19320): Terminated: ok {rc=0} 12:03:44.104518 bus /sierra_3: Setting Powered False 12:03:45.203562 bus /sierra_3: Setting Powered False 12:03:46.329877 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:03:47.486842 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:47.498656 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:03:47.568135 tst mo_mt_call_osmux.py: using LAC 40769 12:03:47.690901 tst mo_mt_call_osmux.py: using RAC 224 12:03:47.810495 tst mo_mt_call_osmux.py: using CellId 40769 12:03:47.933702 tst mo_mt_call_osmux.py: using BVCI 40770 12:03:48.046443 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:48.057608 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:48.068520 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:48.079464 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:48.090826 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:03:48.102054 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:03:48.224225 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:03:48.345449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:48.855378 run create_hlr_db(pid=19323): Launched 12:03:48.989403 bus /sierra_2: Setting Powered False 12:03:50.053971 run create_hlr_db(pid=19323): Terminated: ok {rc=0} 12:03:50.494696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Launched 12:03:50.804732 run osmo-hlr_10.42.42.2(pid=19326): Launched 12:03:50.922544 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:51.466520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19328): Launched 12:03:51.775003 run osmo-stp_10.42.42.5(pid=19329): Launched 12:03:51.894080 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:52.451002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19331): Launched 12:03:52.758884 run osmo-msc_10.42.42.6(pid=19332): Launched 12:03:52.931532 run osmo-stp_10.42.42.5(pid=19329): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19329)] 12:03:53.061293 run osmo-stp_10.42.42.5(pid=19329): stdout: | (launched: 2022-12-14_12:03:51.717495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:53.190993 run osmo-stp_10.42.42.5(pid=19329): stderr: | [0;m[38;5;43m20221214120351888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120351888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120351889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120351889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120351889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120351890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120351890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:53.318910 run osmo-stp_10.42.42.5(pid=19329): stdout: | (launched: 2022-12-14_12:03:51.717495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:53.440306 run osmo-stp_10.42.42.5(pid=19329): stderr: | [0;m[38;5;43m20221214120351888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120351888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120351889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120351889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120351889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120351890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120351890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:53.585982 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19329): Process ended prematurely: osmo-stp_10.42.42.5(pid=19329) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19329)] [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:03:53.595079 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:03:53.621683 run osmo-hlr_10.42.42.2(pid=19326): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19326)] 12:03:53.670341 run osmo-hlr_10.42.42.2(pid=19326): stdout: | (launched: 2022-12-14_12:03:50.747476) 12:03:53.720162 run osmo-hlr_10.42.42.2(pid=19326): stderr: | [0;m[1;31m20221214120350924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120350924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120350924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120350924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120350924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120350925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120350936 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120350944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120350945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120350945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:53.789762 run osmo-msc_10.42.42.6(pid=19332): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19332)] 12:03:53.837413 run osmo-msc_10.42.42.6(pid=19332): stdout: | (launched: 2022-12-14_12:03:52.701084) 12:03:53.887141 run osmo-msc_10.42.42.6(pid=19332): stderr: | [0;m[38;5;43m20221214120352969 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120352969 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5cf2f92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120352970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120352970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120352970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120352970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120352972 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120352972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120352972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120352972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:53.936855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Terminating (SIGTERM) 12:03:53.977132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19328): Terminating (SIGTERM) 12:03:54.017415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19331): Terminating (SIGTERM) 12:03:54.057843 --- ParallelTerminationStrategy: PID 19325 died... 12:03:54.077694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Terminated: ok {rc=0} 12:03:54.122314 --- ParallelTerminationStrategy: PID 19328 died... 12:03:54.141761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19328): Terminated: ok {rc=0} 12:03:54.185650 --- ParallelTerminationStrategy: PID 19331 died... 12:03:54.204664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19331): Terminated: ok {rc=0} 12:03:54.288614 bus /sierra_3: Setting Powered False 12:03:55.383974 bus /sierra_3: Setting Powered False 12:03:56.500018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:03:57.752280 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:57.758937 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:03:57.790762 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:03:57.818214 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:03:57.869302 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:03:57.901314 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:03:57.927625 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:03:58.479665 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:03:58.529013 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:58.540513 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:03:58.609396 tst mo_mt_call.py: using LAC 40770 12:03:58.738760 tst mo_mt_call.py: using RAC 225 12:03:58.867762 tst mo_mt_call.py: using CellId 40770 12:03:58.997400 tst mo_mt_call.py: using BVCI 40771 12:03:59.109821 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:59.121101 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:59.133181 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:59.143959 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:59.155769 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:03:59.167533 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:03:59.287204 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:03:59.407329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:59.917644 run create_hlr_db(pid=19337): Launched 12:04:00.051141 bus /sierra_2: Setting Powered False 12:04:01.114411 run create_hlr_db(pid=19337): Terminated: ok {rc=0} 12:04:01.583562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19339): Launched 12:04:01.931829 run osmo-hlr_10.42.42.2(pid=19340): Launched 12:04:02.163418 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:02.694658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19342): Launched 12:04:03.003700 run osmo-stp_10.42.42.5(pid=19343): Launched 12:04:03.122125 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:03.677518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19345): Launched 12:04:03.985623 run osmo-msc_10.42.42.6(pid=19346): Launched 12:04:04.158177 run osmo-stp_10.42.42.5(pid=19343): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19343)] 12:04:04.289275 run osmo-stp_10.42.42.5(pid=19343): stdout: | (launched: 2022-12-14_12:04:02.946647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:04.419708 run osmo-stp_10.42.42.5(pid=19343): stderr: | [0;m[38;5;43m20221214120403116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120403116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120403116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120403117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120403117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120403117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120403117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:04.548663 run osmo-stp_10.42.42.5(pid=19343): stdout: | (launched: 2022-12-14_12:04:02.946647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:04.670491 run osmo-stp_10.42.42.5(pid=19343): stderr: | [0;m[38;5;43m20221214120403116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120403116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120403116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120403117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120403117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120403117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120403117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:04.816463 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19343): Process ended prematurely: osmo-stp_10.42.42.5(pid=19343) [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19343)] [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:04:04.825400 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:04:04.851683 run osmo-hlr_10.42.42.2(pid=19340): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19340)] 12:04:04.899671 run osmo-hlr_10.42.42.2(pid=19340): stdout: | (launched: 2022-12-14_12:04:01.869070) 12:04:04.949073 run osmo-hlr_10.42.42.2(pid=19340): stderr: | [0;m[1;31m20221214120402159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120402159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120402159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120402159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120402159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120402159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120402171 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120402179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120402180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120402180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:05.018556 run osmo-msc_10.42.42.6(pid=19346): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19346)] 12:04:05.066113 run osmo-msc_10.42.42.6(pid=19346): stdout: | (launched: 2022-12-14_12:04:03.928210) 12:04:05.115301 run osmo-msc_10.42.42.6(pid=19346): stderr: | [0;m[38;5;43m20221214120404198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120404198 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f125facbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120404198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120404198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120404198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120404198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120404200 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120404200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120404200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120404200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:05.164903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19339): Terminating (SIGTERM) 12:04:05.205015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19342): Terminating (SIGTERM) 12:04:05.245153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19345): Terminating (SIGTERM) 12:04:05.285562 --- ParallelTerminationStrategy: PID 19339 died... 12:04:05.305187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19339): Terminated: ok {rc=0} 12:04:05.349460 --- ParallelTerminationStrategy: PID 19342 died... 12:04:05.368304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19342): Terminated: ok {rc=0} 12:04:05.412664 --- ParallelTerminationStrategy: PID 19345 died... 12:04:05.431716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19345): Terminated: ok {rc=0} 12:04:05.518926 bus /sierra_3: Setting Powered False 12:04:06.619064 bus /sierra_3: Setting Powered False 12:04:07.735432 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:04:08.883052 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:04:08.895014 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:04:08.965042 tst mo_mt_call_osmux.py: using LAC 40771 12:04:09.085947 tst mo_mt_call_osmux.py: using RAC 226 12:04:09.207974 tst mo_mt_call_osmux.py: using CellId 40771 12:04:09.330014 tst mo_mt_call_osmux.py: using BVCI 40772 12:04:09.451139 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:04:09.462938 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:04:09.474536 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:04:09.486054 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:04:09.497653 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:04:09.509638 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:04:09.627001 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:04:09.749402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:10.259535 run create_hlr_db(pid=19348): Launched 12:04:10.393503 bus /sierra_2: Setting Powered False 12:04:11.458628 run create_hlr_db(pid=19348): Terminated: ok {rc=0} 12:04:11.897712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19350): Launched 12:04:12.205338 run osmo-hlr_10.42.42.2(pid=19351): Launched 12:04:12.322300 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:12.867297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19353): Launched 12:04:13.177509 run osmo-stp_10.42.42.5(pid=19354): Launched 12:04:13.295797 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:13.852076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19356): Launched 12:04:14.162603 run osmo-msc_10.42.42.6(pid=19357): Launched 12:04:14.336389 run osmo-stp_10.42.42.5(pid=19354): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19354)] 12:04:14.467925 run osmo-stp_10.42.42.5(pid=19354): stdout: | (launched: 2022-12-14_12:04:13.119752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:14.598795 run osmo-stp_10.42.42.5(pid=19354): stderr: | [0;m[38;5;43m20221214120413291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120413291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120413291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120413292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120413292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120413292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120413292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:14.727314 run osmo-stp_10.42.42.5(pid=19354): stdout: | (launched: 2022-12-14_12:04:13.119752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:14.849273 run osmo-stp_10.42.42.5(pid=19354): stderr: | [0;m[38;5;43m20221214120413291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120413291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120413291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120413292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120413292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120413292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120413292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:14.995393 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19354): Process ended prematurely: osmo-stp_10.42.42.5(pid=19354) [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19354)] [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:04:15.004467 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:04:15.030948 run osmo-hlr_10.42.42.2(pid=19351): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19351)] 12:04:15.079501 run osmo-hlr_10.42.42.2(pid=19351): stdout: | (launched: 2022-12-14_12:04:12.147904) 12:04:15.129247 run osmo-hlr_10.42.42.2(pid=19351): stderr: | [0;m[1;31m20221214120412326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120412326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120412326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120412326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120412326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120412327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120412343 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120412352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120412352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120412353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:15.199037 run osmo-msc_10.42.42.6(pid=19357): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19357)] 12:04:15.246536 run osmo-msc_10.42.42.6(pid=19357): stdout: | (launched: 2022-12-14_12:04:14.104695) 12:04:15.296014 run osmo-msc_10.42.42.6(pid=19357): stderr: | [0;m[38;5;43m20221214120414375 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120414375 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4dbd666c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120414375 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120414375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120414375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120414376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120414377 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120414378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120414378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120414378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:15.345729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19350): Terminating (SIGTERM) 12:04:15.386222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19353): Terminating (SIGTERM) 12:04:15.426573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19356): Terminating (SIGTERM) 12:04:15.467303 --- ParallelTerminationStrategy: PID 19350 died... 12:04:15.486909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19350): Terminated: ok {rc=0} 12:04:15.531196 --- ParallelTerminationStrategy: PID 19353 died... 12:04:15.550275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19353): Terminated: ok {rc=0} 12:04:15.594521 --- ParallelTerminationStrategy: PID 19356 died... 12:04:15.613621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19356): Terminated: ok {rc=0} 12:04:15.700246 bus /sierra_3: Setting Powered False 12:04:16.799449 bus /sierra_3: Setting Powered False 12:04:17.914485 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:04:19.170237 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:04:19.177240 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:04:19.211048 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:04:19.238458 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:04:19.289611 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:04:19.322815 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:04:19.350231 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:04:19.903190 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:04:19.955691 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:19.967111 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:04:20.037017 tst mo_mt_call.py: using LAC 40772 12:04:20.163635 tst mo_mt_call.py: using RAC 227 12:04:20.283865 tst mo_mt_call.py: using CellId 40772 12:04:20.402400 tst mo_mt_call.py: using BVCI 40773 12:04:20.513281 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:20.524268 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:20.535191 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:20.546074 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:20.557129 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:20.568352 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:04:20.690547 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:04:20.811776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:21.322753 run create_hlr_db(pid=19362): Launched 12:04:21.459287 bus /sierra_2: Setting Powered False 12:04:22.524675 run create_hlr_db(pid=19362): Terminated: ok {rc=0} 12:04:22.965701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19364): Launched 12:04:23.275504 run osmo-hlr_10.42.42.2(pid=19365): Launched 12:04:23.394157 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:23.939416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19367): Launched 12:04:24.248935 run osmo-stp_10.42.42.5(pid=19368): Launched 12:04:24.367201 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:24.922980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19370): Launched 12:04:25.232680 run osmo-msc_10.42.42.6(pid=19371): Launched 12:04:25.405599 run osmo-stp_10.42.42.5(pid=19368): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19368)] 12:04:25.535680 run osmo-stp_10.42.42.5(pid=19368): stdout: | (launched: 2022-12-14_12:04:24.191673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:25.665562 run osmo-stp_10.42.42.5(pid=19368): stderr: | [0;m[38;5;43m20221214120424365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120424366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120424366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120424366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120424367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120424367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120424367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:25.793116 run osmo-stp_10.42.42.5(pid=19368): stdout: | (launched: 2022-12-14_12:04:24.191673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:25.914318 run osmo-stp_10.42.42.5(pid=19368): stderr: | [0;m[38;5;43m20221214120424365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120424366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120424366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120424366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120424367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120424367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120424367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:26.060120 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19368): Process ended prematurely: osmo-stp_10.42.42.5(pid=19368) [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19368)] [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:04:26.069459 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:04:26.096353 run osmo-hlr_10.42.42.2(pid=19365): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19365)] 12:04:26.145342 run osmo-hlr_10.42.42.2(pid=19365): stdout: | (launched: 2022-12-14_12:04:23.218111) 12:04:26.195518 run osmo-hlr_10.42.42.2(pid=19365): stderr: | [0;m[1;31m20221214120423397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120423397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120423397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120423397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120423397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120423397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120423410 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120423418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120423418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120423418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:26.266068 run osmo-msc_10.42.42.6(pid=19371): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19371)] 12:04:26.314488 run osmo-msc_10.42.42.6(pid=19371): stdout: | (launched: 2022-12-14_12:04:25.175422) 12:04:26.365313 run osmo-msc_10.42.42.6(pid=19371): stderr: | [0;m[38;5;43m20221214120425446 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120425446 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca3c98ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120425446 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120425446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120425446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120425447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120425448 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120425449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120425449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120425449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:26.415987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19364): Terminating (SIGTERM) 12:04:26.456439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19367): Terminating (SIGTERM) 12:04:26.497012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19370): Terminating (SIGTERM) 12:04:26.537882 --- ParallelTerminationStrategy: PID 19364 died... 12:04:26.557580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19364): Terminated: ok {rc=0} 12:04:26.602611 --- ParallelTerminationStrategy: PID 19367 died... 12:04:26.621820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19367): Terminated: ok {rc=0} 12:04:26.667201 --- ParallelTerminationStrategy: PID 19370 died... 12:04:26.686738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19370): Terminated: ok {rc=0} 12:04:26.771291 bus /sierra_3: Setting Powered False 12:04:27.867958 bus /sierra_3: Setting Powered False 12:04:28.985793 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:04:30.135435 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:30.147655 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:04:30.220391 tst mo_mt_call_osmux.py: using LAC 40773 12:04:30.350452 tst mo_mt_call_osmux.py: using RAC 228 12:04:30.471377 tst mo_mt_call_osmux.py: using CellId 40773 12:04:30.593594 tst mo_mt_call_osmux.py: using BVCI 40774 12:04:30.705750 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:30.716862 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:30.727941 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:30.738951 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:30.750455 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:04:30.761763 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:04:30.885094 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:04:31.019026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:31.511073 run create_hlr_db(pid=19373): Launched 12:04:31.664762 bus /sierra_2: Setting Powered False 12:04:32.725950 run create_hlr_db(pid=19373): Terminated: ok {rc=0} 12:04:33.155302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19375): Launched 12:04:33.464332 run osmo-hlr_10.42.42.2(pid=19376): Launched 12:04:33.580724 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:34.123339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19378): Launched 12:04:34.431109 run osmo-stp_10.42.42.5(pid=19379): Launched 12:04:34.549918 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:35.110290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19381): Launched 12:04:35.419698 run osmo-msc_10.42.42.6(pid=19382): Launched 12:04:35.592811 run osmo-stp_10.42.42.5(pid=19379): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19379)] 12:04:35.723280 run osmo-stp_10.42.42.5(pid=19379): stdout: | (launched: 2022-12-14_12:04:34.373540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:35.853488 run osmo-stp_10.42.42.5(pid=19379): stderr: | [0;m[38;5;43m20221214120434545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120434546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120434546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120434546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120434547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120434547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120434547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:35.981338 run osmo-stp_10.42.42.5(pid=19379): stdout: | (launched: 2022-12-14_12:04:34.373540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:36.103440 run osmo-stp_10.42.42.5(pid=19379): stderr: | [0;m[38;5;43m20221214120434545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120434546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120434546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120434546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120434547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120434547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120434547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:36.249808 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19379): Process ended prematurely: osmo-stp_10.42.42.5(pid=19379) [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19379)] [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:04:36.258997 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:04:36.285648 run osmo-hlr_10.42.42.2(pid=19376): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19376)] 12:04:36.334548 run osmo-hlr_10.42.42.2(pid=19376): stdout: | (launched: 2022-12-14_12:04:33.406926) 12:04:36.384659 run osmo-hlr_10.42.42.2(pid=19376): stderr: | [0;m[1;31m20221214120433583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120433583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120433584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120433584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120433584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120433584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120433596 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120433604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120433604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120433604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:36.454825 run osmo-msc_10.42.42.6(pid=19382): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19382)] 12:04:36.502922 run osmo-msc_10.42.42.6(pid=19382): stdout: | (launched: 2022-12-14_12:04:35.362181) 12:04:36.553209 run osmo-msc_10.42.42.6(pid=19382): stderr: | [0;m[38;5;43m20221214120435631 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120435631 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc237546c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120435632 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120435632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120435632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120435632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120435634 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120435634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120435634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120435634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:36.603881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19375): Terminating (SIGTERM) 12:04:36.644497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19378): Terminating (SIGTERM) 12:04:36.685243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19381): Terminating (SIGTERM) 12:04:36.726592 --- ParallelTerminationStrategy: PID 19375 died... 12:04:36.746457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19375): Terminated: ok {rc=0} 12:04:36.791035 --- ParallelTerminationStrategy: PID 19378 died... 12:04:36.810268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19378): Terminated: ok {rc=0} 12:04:36.854454 --- ParallelTerminationStrategy: PID 19381 died... 12:04:36.873397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19381): Terminated: ok {rc=0} 12:04:36.957592 bus /sierra_3: Setting Powered False 12:04:38.053425 bus /sierra_3: Setting Powered False 12:04:39.169367 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:04:40.418634 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:04:40.426510 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:04:40.459592 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 12:04:40.487591 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 12:04:40.543004 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:04:40.576174 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 12:04:40.603558 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 12:04:41.152327 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 12:04:41.203308 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:41.215096 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:04:41.266852 tst mo_mt_call.py: using LAC 40774 12:04:41.389061 tst mo_mt_call.py: using RAC 229 12:04:41.510072 tst mo_mt_call.py: using CellId 40774 12:04:41.632288 tst mo_mt_call.py: using BVCI 40775 12:04:41.745205 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:41.756565 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:41.767805 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:41.778862 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:41.790461 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:41.802138 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:04:41.924430 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:04:42.045430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:42.554873 run create_hlr_db(pid=19388): Launched 12:04:42.689232 bus /sierra_2: Setting Powered False 12:04:43.753777 run create_hlr_db(pid=19388): Terminated: ok {rc=0} 12:04:44.192681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19390): Launched 12:04:44.501813 run osmo-hlr_10.42.42.2(pid=19391): Launched 12:04:44.620222 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:45.160285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19393): Launched 12:04:45.468860 run osmo-stp_10.42.42.5(pid=19394): Launched 12:04:45.585737 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:46.193900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19396): Launched 12:04:46.547051 run osmo-msc_10.42.42.6(pid=19397): Launched 12:04:46.919681 run osmo-stp_10.42.42.5(pid=19394): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19394)] 12:04:47.198924 run osmo-stp_10.42.42.5(pid=19394): stdout: | (launched: 2022-12-14_12:04:45.411699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:47.363744 run osmo-stp_10.42.42.5(pid=19394): stderr: | [0;m[38;5;43m20221214120445584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120445584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120445585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120445585 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120445586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120445586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120445586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:47.501401 run osmo-stp_10.42.42.5(pid=19394): stdout: | (launched: 2022-12-14_12:04:45.411699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:47.632802 run osmo-stp_10.42.42.5(pid=19394): stderr: | [0;m[38;5;43m20221214120445584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120445584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120445585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120445585 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120445586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120445586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120445586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:47.789317 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19394): Process ended prematurely: osmo-stp_10.42.42.5(pid=19394) [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19394)] [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 12:04:47.799085 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:04:47.827221 run osmo-hlr_10.42.42.2(pid=19391): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19391)] 12:04:47.877915 run osmo-hlr_10.42.42.2(pid=19391): stdout: | (launched: 2022-12-14_12:04:44.444601) 12:04:47.930480 run osmo-hlr_10.42.42.2(pid=19391): stderr: | [0;m[1;31m20221214120444623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120444623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120444623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120444623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120444623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120444623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120444635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120444644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120444644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120444644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:48.003744 run osmo-msc_10.42.42.6(pid=19397): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19397)] 12:04:48.054099 run osmo-msc_10.42.42.6(pid=19397): stdout: | (launched: 2022-12-14_12:04:46.480021) 12:04:48.106586 run osmo-msc_10.42.42.6(pid=19397): stderr: | [0;m[38;5;43m20221214120446987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120446987 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5de3b7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120446988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120446988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120446988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120446988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120446990 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120446990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120446990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120446991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:48.158787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19390): Terminating (SIGTERM) 12:04:48.201067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19393): Terminating (SIGTERM) 12:04:48.243232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19396): Terminating (SIGTERM) 12:04:48.286229 --- ParallelTerminationStrategy: PID 19390 died... 12:04:48.306535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19390): Terminated: ok {rc=0} 12:04:48.353533 --- ParallelTerminationStrategy: PID 19393 died... 12:04:48.373444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19393): Terminated: ok {rc=0} 12:04:48.419992 --- ParallelTerminationStrategy: PID 19396 died... 12:04:48.439818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19396): Terminated: ok {rc=0} 12:04:48.528510 bus /sierra_3: Setting Powered False 12:04:49.628674 bus /sierra_3: Setting Powered False 12:04:50.748113 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 12:04:51.895991 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:51.907942 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:04:51.964691 tst mo_mt_call_osmux.py: using LAC 40775 12:04:52.085582 tst mo_mt_call_osmux.py: using RAC 230 12:04:52.213104 tst mo_mt_call_osmux.py: using CellId 40775 12:04:52.339798 tst mo_mt_call_osmux.py: using BVCI 40776 12:04:52.458952 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:52.470753 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:52.482330 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:52.493870 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:52.505629 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:04:52.517159 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:04:52.635156 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:04:52.756812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:53.269778 run create_hlr_db(pid=19399): Launched 12:04:53.403359 bus /sierra_2: Setting Powered False 12:04:54.468490 run create_hlr_db(pid=19399): Terminated: ok {rc=0} 12:04:54.911665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19401): Launched 12:04:55.221656 run osmo-hlr_10.42.42.2(pid=19402): Launched 12:04:55.340643 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:55.886799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19404): Launched 12:04:56.195003 run osmo-stp_10.42.42.5(pid=19405): Launched 12:04:56.310957 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:56.866357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19407): Launched 12:04:57.174498 run osmo-msc_10.42.42.6(pid=19408): Launched 12:04:57.348294 run osmo-stp_10.42.42.5(pid=19405): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19405)] 12:04:57.478932 run osmo-stp_10.42.42.5(pid=19405): stdout: | (launched: 2022-12-14_12:04:56.137155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:57.610219 run osmo-stp_10.42.42.5(pid=19405): stderr: | [0;m[38;5;43m20221214120456307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120456307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120456307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120456307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120456308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120456308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120456308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:57.738956 run osmo-stp_10.42.42.5(pid=19405): stdout: | (launched: 2022-12-14_12:04:56.137155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:57.860758 run osmo-stp_10.42.42.5(pid=19405): stderr: | [0;m[38;5;43m20221214120456307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120456307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120456307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120456307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120456308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120456308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120456308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:58.007299 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19405): Process ended prematurely: osmo-stp_10.42.42.5(pid=19405) [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19405)] [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 12:04:58.016346 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:04:58.042764 run osmo-hlr_10.42.42.2(pid=19402): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19402)] 12:04:58.091436 run osmo-hlr_10.42.42.2(pid=19402): stdout: | (launched: 2022-12-14_12:04:55.163797) 12:04:58.141602 run osmo-hlr_10.42.42.2(pid=19402): stderr: | [0;m[1;31m20221214120455339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120455339 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120455340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120455340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120455340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120455340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120455352 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120455360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120455360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120455360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:58.211453 run osmo-msc_10.42.42.6(pid=19408): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19408)] 12:04:58.259117 run osmo-msc_10.42.42.6(pid=19408): stdout: | (launched: 2022-12-14_12:04:57.116765) 12:04:58.308657 run osmo-msc_10.42.42.6(pid=19408): stderr: | [0;m[38;5;43m20221214120457385 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120457385 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f3c85dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120457386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120457386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120457386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120457386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120457388 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120457388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120457388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120457388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:58.358850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19401): Terminating (SIGTERM) 12:04:58.398959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19404): Terminating (SIGTERM) 12:04:58.439063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19407): Terminating (SIGTERM) 12:04:58.479347 --- ParallelTerminationStrategy: PID 19401 died... 12:04:58.498857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19401): Terminated: ok {rc=0} 12:04:58.543178 --- ParallelTerminationStrategy: PID 19404 died... 12:04:58.562220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19404): Terminated: ok {rc=0} 12:04:58.606291 --- ParallelTerminationStrategy: PID 19407 died... 12:04:58.625375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19407): Terminated: ok {rc=0} 12:04:58.710058 bus /sierra_3: Setting Powered False 12:04:59.807541 bus /sierra_3: Setting Powered False 12:05:00.938624 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 emergency:trx-umtrx --------------------------------------------------------------------- 12:05:02.213119 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:05:02.218317 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:05:02.251761 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:05:02.279713 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 12:05:02.366010 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:05:02.398643 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:05:02.426547 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 12:05:03.012598 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2404 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 12:05:03.018792 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:03.030491 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 12:05:03.080137 tst emergency_mo_mt_call.py: using LAC 40776 12:05:03.207045 tst emergency_mo_mt_call.py: using RAC 231 12:05:03.331536 tst emergency_mo_mt_call.py: using CellId 40776 12:05:03.456037 tst emergency_mo_mt_call.py: using BVCI 40777 12:05:03.565972 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:03.576630 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:03.587250 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:03.598036 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:03.608717 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:03.619994 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:03.741190 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:03.862921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:04.364245 run create_hlr_db(pid=19416): Launched 12:05:04.495512 bus /sierra_2: Setting Powered False 12:05:05.559613 run create_hlr_db(pid=19416): Terminated: ok {rc=0} 12:05:05.994114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19418): Launched 12:05:06.296920 run osmo-hlr_10.42.42.2(pid=19419): Launched 12:05:06.413339 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:06.946255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19421): Launched 12:05:07.251598 run osmo-stp_10.42.42.5(pid=19422): Launched 12:05:07.377532 tst emergency_mo_mt_call.py: using MSISDN 8673 12:05:07.532131 run osmo-msc_10.42.42.6: Starting osmo-msc 12:05:08.076241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19424): Launched 12:05:08.381869 run osmo-msc_10.42.42.6(pid=19425): Launched 12:05:08.552253 run osmo-stp_10.42.42.5(pid=19422): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19422)] 12:05:08.681352 run osmo-stp_10.42.42.5(pid=19422): stdout: | (launched: 2022-12-14_12:05:07.194761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:08.809668 run osmo-stp_10.42.42.5(pid=19422): stderr: | [0;m[38;5;43m20221214120507363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120507364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120507364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120507364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120507365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120507365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120507365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:08.935926 run osmo-stp_10.42.42.5(pid=19422): stdout: | (launched: 2022-12-14_12:05:07.194761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:09.057618 run osmo-stp_10.42.42.5(pid=19422): stderr: | [0;m[38;5;43m20221214120507363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120507364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120507364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120507364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120507365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120507365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120507365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:09.202021 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19422): Process ended prematurely: osmo-stp_10.42.42.5(pid=19422) [trial-2404↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19422)] [trial-2404↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 12:05:09.210368 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 12:05:09.236573 run osmo-hlr_10.42.42.2(pid=19419): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19419)] 12:05:09.285310 run osmo-hlr_10.42.42.2(pid=19419): stdout: | (launched: 2022-12-14_12:05:06.240527) 12:05:09.335431 run osmo-hlr_10.42.42.2(pid=19419): stderr: | [0;m[1;31m20221214120506415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120506415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120506415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120506415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120506415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120506415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120506430 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120506440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120506441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120506441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:09.405531 run osmo-msc_10.42.42.6(pid=19425): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19425)] 12:05:09.453506 run osmo-msc_10.42.42.6(pid=19425): stdout: | (launched: 2022-12-14_12:05:08.324620) 12:05:09.503506 run osmo-msc_10.42.42.6(pid=19425): stderr: | [0;m[38;5;43m20221214120508593 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120508593 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f587a805c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120508593 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120508593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120508593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120508594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120508596 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120508596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120508596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120508596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:05:09.554004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19418): Terminating (SIGTERM) 12:05:09.594466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19421): Terminating (SIGTERM) 12:05:09.634840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19424): Terminating (SIGTERM) 12:05:09.675501 --- ParallelTerminationStrategy: PID 19418 died... 12:05:09.695039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19418): Terminated: ok {rc=0} 12:05:09.739638 --- ParallelTerminationStrategy: PID 19421 died... 12:05:09.758719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19421): Terminated: ok {rc=0} 12:05:09.803398 --- ParallelTerminationStrategy: PID 19424 died... 12:05:09.822413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19424): Terminated: ok {rc=0} 12:05:09.908901 bus /sierra_3: Setting Powered False 12:05:11.010271 bus /sierra_3: Setting Powered False 12:05:12.124201 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 12:05:13.211432 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:13.223544 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 12:05:13.274858 tst emergency_preemptive_call.py: using LAC 40777 12:05:13.394999 tst emergency_preemptive_call.py: using RAC 232 12:05:13.514943 tst emergency_preemptive_call.py: using CellId 40777 12:05:13.632683 tst emergency_preemptive_call.py: using BVCI 40778 12:05:13.741965 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:13.752585 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:13.763196 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:13.773757 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:13.784161 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 12:05:13.795159 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:13.910801 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:14.039123 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:14.157165 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:14.276665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:14.783388 run create_hlr_db(pid=19427): Launched 12:05:14.915010 bus /sierra_2: Setting Powered False 12:05:15.987257 run create_hlr_db(pid=19427): Terminated: ok {rc=0} 12:05:16.452040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19429): Launched 12:05:16.780443 run osmo-hlr_10.42.42.2(pid=19430): Launched 12:05:17.012679 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:17.624079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19432): Launched 12:05:17.949582 run osmo-stp_10.42.42.5(pid=19433): Launched 12:05:18.081829 tst emergency_preemptive_call.py: using MSISDN 8674 12:05:18.246507 run osmo-msc_10.42.42.6: Starting osmo-msc 12:05:18.827795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19435): Launched 12:05:19.152340 run osmo-msc_10.42.42.6(pid=19436): Launched 12:05:19.334078 run osmo-stp_10.42.42.5(pid=19433): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19433)] 12:05:19.507902 run osmo-stp_10.42.42.5(pid=19433): stdout: | (launched: 2022-12-14_12:05:17.889099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:19.645650 run osmo-stp_10.42.42.5(pid=19433): stderr: | [0;m[38;5;43m20221214120518083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120518083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120518083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120518084 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120518084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120518085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120518085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:19.780303 run osmo-stp_10.42.42.5(pid=19433): stdout: | (launched: 2022-12-14_12:05:17.889099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:19.909094 run osmo-stp_10.42.42.5(pid=19433): stderr: | [0;m[38;5;43m20221214120518083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120518083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120518083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120518084 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120518084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120518085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120518085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:20.063004 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19433): Process ended prematurely: osmo-stp_10.42.42.5(pid=19433) [trial-2404↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19433)] [trial-2404↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 12:05:20.072084 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 12:05:20.099740 run osmo-hlr_10.42.42.2(pid=19430): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19430)] 12:05:20.149798 run osmo-hlr_10.42.42.2(pid=19430): stdout: | (launched: 2022-12-14_12:05:16.721819) 12:05:20.201586 run osmo-hlr_10.42.42.2(pid=19430): stderr: | [0;m[1;31m20221214120517065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120517065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120517065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120517065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120517065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120517065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120517085 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120517093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120517093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120517093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:20.273910 run osmo-msc_10.42.42.6(pid=19436): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19436)] 12:05:20.323772 run osmo-msc_10.42.42.6(pid=19436): stdout: | (launched: 2022-12-14_12:05:19.092166) 12:05:20.375564 run osmo-msc_10.42.42.6(pid=19436): stderr: | [0;m[38;5;43m20221214120519413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214120519414 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e54931c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214120519414 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214120519414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214120519415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214120519415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214120519417 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214120519417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214120519417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214120519417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:05:20.427281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19429): Terminating (SIGTERM) 12:05:20.469034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19432): Terminating (SIGTERM) 12:05:20.511010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19435): Terminating (SIGTERM) 12:05:20.554031 --- ParallelTerminationStrategy: PID 19429 died... 12:05:20.574228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19429): Terminated: ok {rc=0} 12:05:20.620787 --- ParallelTerminationStrategy: PID 19432 died... 12:05:20.640892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19432): Terminated: ok {rc=0} 12:05:20.686832 --- ParallelTerminationStrategy: PID 19435 died... 12:05:20.706345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19435): Terminated: ok {rc=0} 12:05:20.794335 bus /sierra_9: Setting Powered False 12:05:21.893365 bus /sierra_9: Setting Powered False 12:05:23.010729 bus /sierra_8: Setting Powered False 12:05:24.111351 bus /sierra_8: Setting Powered False 12:05:25.227765 bus /sierra_3: Setting Powered False 12:05:26.326273 bus /sierra_3: Setting Powered False 12:05:27.440503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx --------------------------------------------------------------------- 12:05:28.719863 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:05:28.724613 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 12:05:28.758738 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 12:05:28.797908 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 12:05:28.890718 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 12:05:28.924206 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 12:05:28.963847 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 12:05:29.550600 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 12:05:29.604525 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:29.615616 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:05:29.663347 tst cs_paging_gprs_active.py: using LAC 40778 12:05:29.795157 tst cs_paging_gprs_active.py: using RAC 233 12:05:29.922444 tst cs_paging_gprs_active.py: using CellId 40778 12:05:30.049108 tst cs_paging_gprs_active.py: using BVCI 40779 12:05:30.168160 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:30.179302 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:30.190227 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:30.201209 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:30.212133 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:30.222941 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:30.233978 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:30.244683 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:30.255752 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:30.374838 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:30.490734 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:05:30.698028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:31.011916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19443): Launched 12:05:31.324547 run iperf3-srv_10.42.42.10(pid=19444): Launched 12:05:31.464269 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:05:31.695380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:32.041740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19445): Launched 12:05:32.324230 run iperf3-srv_10.42.42.10(pid=19446): Launched 12:05:32.441483 tst cs_paging_gprs_active.py:38: start network... 12:05:32.647093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:33.124469 run create_hlr_db(pid=19447): Launched 12:05:33.246037 bus /sierra_2: Setting Powered False 12:05:34.307454 run create_hlr_db(pid=19447): Terminated: ok {rc=0} 12:05:34.759818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19449): Launched 12:05:35.091432 run osmo-hlr_10.42.42.2(pid=19450): Launched 12:05:35.219815 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:35.789991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19452): Launched 12:05:36.120651 run osmo-stp_10.42.42.5(pid=19453): Launched 12:05:36.247199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:36.817661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19455): Launched 12:05:36.943464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:37.223540 run patchelf(pid=19456): Launched 12:05:37.407907 run osmo-stp_10.42.42.5(pid=19453): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19453)] 12:05:37.547341 run osmo-stp_10.42.42.5(pid=19453): stdout: | (launched: 2022-12-14_12:05:36.059298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:37.688798 run osmo-stp_10.42.42.5(pid=19453): stderr: | [0;m[38;5;43m20221214120536253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120536254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120536254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120536254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120536255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120536255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120536255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:37.830315 run osmo-stp_10.42.42.5(pid=19453): stdout: | (launched: 2022-12-14_12:05:36.059298) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:37.965364 run osmo-stp_10.42.42.5(pid=19453): stderr: | [0;m[38;5;43m20221214120536253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120536254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120536254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120536254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120536255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120536255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120536255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:38.125450 run patchelf(pid=19456): Terminating (SIGINT) 12:05:38.310264 run patchelf(pid=19456): Terminated: ok {rc=0} 12:05:38.443452 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19453): Process ended prematurely: osmo-stp_10.42.42.5(pid=19453) [trial-2404↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19453)] [trial-2404↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 12:05:38.453723 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:05:38.482480 run osmo-hlr_10.42.42.2(pid=19450): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19450)] 12:05:38.532665 run osmo-hlr_10.42.42.2(pid=19450): stdout: | (launched: 2022-12-14_12:05:35.030145) 12:05:38.585238 run osmo-hlr_10.42.42.2(pid=19450): stderr: | [0;m[1;31m20221214120535233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120535233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120535233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120535233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120535233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120535233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120535247 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120535257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120535257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120535257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:38.637631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19443): Terminating (SIGTERM) 12:05:38.679885 run iperf3-srv_10.42.42.10(pid=19444): Terminating (SIGTERM) 12:05:38.722553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19445): Terminating (SIGTERM) 12:05:38.764694 run iperf3-srv_10.42.42.10(pid=19446): Terminating (SIGTERM) 12:05:38.807085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19449): Terminating (SIGTERM) 12:05:38.849296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19452): Terminating (SIGTERM) 12:05:38.891405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19455): Terminating (SIGTERM) 12:05:38.933823 --- ParallelTerminationStrategy: PID 19443 died... 12:05:38.954021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19443): Terminated: ok {rc=0} 12:05:39.000357 --- ParallelTerminationStrategy: PID 19444 died... 12:05:39.019978 run iperf3-srv_10.42.42.10(pid=19444): Terminated {rc=256} 12:05:39.065967 --- ParallelTerminationStrategy: PID 19445 died... 12:05:39.085660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19445): Terminated: ok {rc=0} 12:05:39.131746 --- ParallelTerminationStrategy: PID 19446 died... 12:05:39.151400 run iperf3-srv_10.42.42.10(pid=19446): Terminated {rc=256} 12:05:39.197491 --- ParallelTerminationStrategy: PID 19449 died... 12:05:39.217375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19449): Terminated: ok {rc=0} 12:05:39.263565 --- ParallelTerminationStrategy: PID 19452 died... 12:05:39.283278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19452): Terminated: ok {rc=0} 12:05:39.329463 --- ParallelTerminationStrategy: PID 19455 died... 12:05:39.349276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19455): Terminated: ok {rc=0} 12:05:39.438067 bus /gobi_0: Setting Powered False 12:05:40.538657 bus /gobi_0: Setting Powered False 12:05:41.657393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx iperf3.py ---------------------------------------------- 12:05:42.807986 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:42.819793 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:05:42.870298 tst iperf3.py: using LAC 40779 12:05:42.999489 tst iperf3.py: using RAC 234 12:05:43.131042 tst iperf3.py: using CellId 40779 12:05:43.266369 tst iperf3.py: using BVCI 40780 12:05:43.388256 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:43.399469 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:43.410493 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:43.421391 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:43.432191 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:43.443019 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:43.454074 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:43.464882 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:43.475882 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:43.595364 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:05:43.819083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:44.151523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19457): Launched 12:05:44.440638 run iperf3-srv_10.42.42.10(pid=19458): Launched 12:05:44.565017 tst iperf3.py:8: start network... 12:05:44.787707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:45.300621 run create_hlr_db(pid=19459): Launched 12:05:45.434947 bus /gobi_6: Setting Powered False 12:05:46.502003 run create_hlr_db(pid=19459): Terminated: ok {rc=0} 12:05:47.033951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19461): Launched 12:05:47.361262 run osmo-hlr_10.42.42.2(pid=19462): Launched 12:05:47.483414 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:48.018946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19464): Launched 12:05:48.328239 run osmo-stp_10.42.42.5(pid=19465): Launched 12:05:48.445715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:05:48.978869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19467): Launched 12:05:49.098406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:05:49.360165 run patchelf(pid=19468): Launched 12:05:49.533525 run osmo-stp_10.42.42.5(pid=19465): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19465)] 12:05:49.664417 run osmo-stp_10.42.42.5(pid=19465): stdout: | (launched: 2022-12-14_12:05:48.270762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:49.797238 run osmo-stp_10.42.42.5(pid=19465): stderr: | [0;m[38;5;43m20221214120548444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120548444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120548445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120548445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120548446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120548446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120548446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:49.929524 run osmo-stp_10.42.42.5(pid=19465): stdout: | (launched: 2022-12-14_12:05:48.270762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:50.056045 run osmo-stp_10.42.42.5(pid=19465): stderr: | [0;m[38;5;43m20221214120548444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120548444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120548445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120548445 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120548446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120548446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120548446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:50.205873 run patchelf(pid=19468): Terminating (SIGINT) 12:05:50.378866 run patchelf(pid=19468): Terminated: ok {rc=0} 12:05:50.503531 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19465): Process ended prematurely: osmo-stp_10.42.42.5(pid=19465) [trial-2404↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19465)] [trial-2404↪gprs:trx-umtrx↪iperf3.py:8] 12:05:50.512882 tst iperf3.py:8: Test FAILED (7.7 sec) 12:05:50.540224 run osmo-hlr_10.42.42.2(pid=19462): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19462)] 12:05:50.589097 run osmo-hlr_10.42.42.2(pid=19462): stdout: | (launched: 2022-12-14_12:05:47.303423) 12:05:50.639167 run osmo-hlr_10.42.42.2(pid=19462): stderr: | [0;m[1;31m20221214120547480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120547480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120547480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120547480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120547480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120547480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120547492 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120547500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120547500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120547500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:50.689381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19457): Terminating (SIGTERM) 12:05:50.729721 run iperf3-srv_10.42.42.10(pid=19458): Terminating (SIGTERM) 12:05:50.770112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19461): Terminating (SIGTERM) 12:05:50.810903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19464): Terminating (SIGTERM) 12:05:50.851901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19467): Terminating (SIGTERM) 12:05:50.893212 --- ParallelTerminationStrategy: PID 19457 died... 12:05:50.912941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19457): Terminated: ok {rc=0} 12:05:50.957947 --- ParallelTerminationStrategy: PID 19458 died... 12:05:50.977111 run iperf3-srv_10.42.42.10(pid=19458): Terminated {rc=256} 12:05:51.021773 --- ParallelTerminationStrategy: PID 19461 died... 12:05:51.040988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19461): Terminated: ok {rc=0} 12:05:51.085506 --- ParallelTerminationStrategy: PID 19464 died... 12:05:51.104772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19464): Terminated: ok {rc=0} 12:05:51.149413 --- ParallelTerminationStrategy: PID 19467 died... 12:05:51.168424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19467): Terminated: ok {rc=0} 12:05:51.255499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 12:05:52.403122 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:52.414480 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:05:52.462705 tst iperf3m4.py: using LAC 40780 12:05:52.583726 tst iperf3m4.py: using RAC 235 12:05:52.706181 tst iperf3m4.py: using CellId 40780 12:05:52.826360 tst iperf3m4.py: using BVCI 40781 12:05:52.939763 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:52.950558 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:52.961105 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:52.971542 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:52.982268 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:52.993449 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:53.004472 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:53.015473 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:05:53.026558 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:53.151593 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:53.281085 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:53.399700 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:05:53.521371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:05:53.744885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:54.075784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19469): Launched 12:05:54.364604 run iperf3-srv_10.42.42.10(pid=19470): Launched 12:05:54.489620 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:05:54.712248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:55.043769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19471): Launched 12:05:55.333570 run iperf3-srv_10.42.42.10(pid=19472): Launched 12:05:55.457571 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:05:55.679754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:56.011472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19473): Launched 12:05:56.299231 run iperf3-srv_10.42.42.10(pid=19474): Launched 12:05:56.424174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:05:56.647465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:05:56.979720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19475): Launched 12:05:57.270709 run iperf3-srv_10.42.42.10(pid=19476): Launched 12:05:57.394808 tst iperf3m4.py:8: start network... 12:05:57.616737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:58.129384 run create_hlr_db(pid=19477): Launched 12:05:58.258661 bus /gobi_6: Setting Powered False 12:05:59.319933 run create_hlr_db(pid=19477): Terminated: ok {rc=0} 12:05:59.750592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19479): Launched 12:06:00.060736 run osmo-hlr_10.42.42.2(pid=19480): Launched 12:06:00.179206 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:00.725943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19482): Launched 12:06:01.052446 run osmo-stp_10.42.42.5(pid=19483): Launched 12:06:01.275919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:01.987765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19485): Launched 12:06:02.127280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:02.412452 run patchelf(pid=19486): Launched 12:06:02.584409 run osmo-stp_10.42.42.5(pid=19483): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19483)] 12:06:02.715630 run osmo-stp_10.42.42.5(pid=19483): stdout: | (launched: 2022-12-14_12:06:00.993230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:02.848591 run osmo-stp_10.42.42.5(pid=19483): stderr: | [0;m[38;5;43m20221214120601256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120601256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120601256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120601257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120601257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120601257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120601257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:02.981499 run osmo-stp_10.42.42.5(pid=19483): stdout: | (launched: 2022-12-14_12:06:00.993230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:03.108117 run osmo-stp_10.42.42.5(pid=19483): stderr: | [0;m[38;5;43m20221214120601256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120601256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120601256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120601257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120601257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120601257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120601257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:03.258948 run patchelf(pid=19486): Terminating (SIGINT) 12:06:03.432582 run patchelf(pid=19486): Terminated: ok {rc=0} 12:06:03.557515 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19483): Process ended prematurely: osmo-stp_10.42.42.5(pid=19483) [trial-2404↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19483)] [trial-2404↪gprs:trx-umtrx↪iperf3m4.py:8] 12:06:03.567084 tst iperf3m4.py:8: Test FAILED (11.2 sec) 12:06:03.594669 run osmo-hlr_10.42.42.2(pid=19480): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19480)] 12:06:03.643452 run osmo-hlr_10.42.42.2(pid=19480): stdout: | (launched: 2022-12-14_12:06:00.003015) 12:06:03.693363 run osmo-hlr_10.42.42.2(pid=19480): stderr: | [0;m[1;31m20221214120600181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120600181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120600181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120600181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120600181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120600182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120600194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120600202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120600202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120600202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:03.743774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19469): Terminating (SIGTERM) 12:06:03.784457 run iperf3-srv_10.42.42.10(pid=19470): Terminating (SIGTERM) 12:06:03.824806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19471): Terminating (SIGTERM) 12:06:03.865362 run iperf3-srv_10.42.42.10(pid=19472): Terminating (SIGTERM) 12:06:03.905673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19473): Terminating (SIGTERM) 12:06:03.946142 run iperf3-srv_10.42.42.10(pid=19474): Terminating (SIGTERM) 12:06:03.986379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19475): Terminating (SIGTERM) 12:06:04.026581 run iperf3-srv_10.42.42.10(pid=19476): Terminating (SIGTERM) 12:06:04.066656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19479): Terminating (SIGTERM) 12:06:04.106945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19482): Terminating (SIGTERM) 12:06:04.147014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19485): Terminating (SIGTERM) 12:06:04.187306 --- ParallelTerminationStrategy: PID 19469 died... 12:06:04.206339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19469): Terminated: ok {rc=0} 12:06:04.250603 --- ParallelTerminationStrategy: PID 19470 died... 12:06:04.269721 run iperf3-srv_10.42.42.10(pid=19470): Terminated {rc=256} 12:06:04.313725 --- ParallelTerminationStrategy: PID 19471 died... 12:06:04.332622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19471): Terminated: ok {rc=0} 12:06:04.377701 --- ParallelTerminationStrategy: PID 19472 died... 12:06:04.396760 run iperf3-srv_10.42.42.10(pid=19472): Terminated {rc=256} 12:06:04.440762 --- ParallelTerminationStrategy: PID 19473 died... 12:06:04.459847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19473): Terminated: ok {rc=0} 12:06:04.503988 --- ParallelTerminationStrategy: PID 19474 died... 12:06:04.522906 run iperf3-srv_10.42.42.10(pid=19474): Terminated {rc=256} 12:06:04.566924 --- ParallelTerminationStrategy: PID 19475 died... 12:06:04.585908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19475): Terminated: ok {rc=0} 12:06:04.630000 --- ParallelTerminationStrategy: PID 19476 died... 12:06:04.649123 run iperf3-srv_10.42.42.10(pid=19476): Terminated {rc=256} 12:06:04.693199 --- ParallelTerminationStrategy: PID 19479 died... 12:06:04.712202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19479): Terminated: ok {rc=0} 12:06:04.756390 --- ParallelTerminationStrategy: PID 19482 died... 12:06:04.775683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19482): Terminated: ok {rc=0} 12:06:04.819750 --- ParallelTerminationStrategy: PID 19485 died... 12:06:04.838675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19485): Terminated: ok {rc=0} 12:06:04.924760 bus /gobi_4: Setting Powered False 12:06:06.024692 bus /gobi_4: Setting Powered False 12:06:07.140631 bus /gobi_1: Setting Powered False 12:06:08.239842 bus /gobi_1: Setting Powered False 12:06:09.355081 bus /gobi_0: Setting Powered False 12:06:10.454785 bus /gobi_0: Setting Powered False 12:06:11.571167 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx ping.py ---------------------------------------------- 12:06:12.671182 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:12.682476 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:06:12.730340 tst ping.py: using LAC 40781 12:06:12.847899 tst ping.py: using RAC 236 12:06:12.965981 tst ping.py: using CellId 40781 12:06:13.085569 tst ping.py: using BVCI 40782 12:06:13.204016 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:13.215264 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:13.226481 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:13.237543 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:13.248481 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:13.259440 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:13.270479 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:13.281475 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:06:13.399402 tst ping.py:19: start network... 12:06:13.602523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:14.070352 run create_hlr_db(pid=19487): Launched 12:06:14.187469 bus /gobi_6: Setting Powered False 12:06:15.247653 run create_hlr_db(pid=19487): Terminated: ok {rc=0} 12:06:15.670634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19489): Launched 12:06:15.991932 run osmo-hlr_10.42.42.2(pid=19490): Launched 12:06:16.174532 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:16.795426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19492): Launched 12:06:17.117291 run osmo-stp_10.42.42.5(pid=19493): Launched 12:06:17.355034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:18.007726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19495): Launched 12:06:18.125229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:18.380927 run patchelf(pid=19496): Launched 12:06:18.550436 run osmo-stp_10.42.42.5(pid=19493): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19493)] 12:06:18.679715 run osmo-stp_10.42.42.5(pid=19493): stdout: | (launched: 2022-12-14_12:06:17.059290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:18.809776 run osmo-stp_10.42.42.5(pid=19493): stderr: | [0;m[38;5;43m20221214120617391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120617391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120617391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120617391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120617399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120617400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120617400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:18.940199 run osmo-stp_10.42.42.5(pid=19493): stdout: | (launched: 2022-12-14_12:06:17.059290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:19.063863 run osmo-stp_10.42.42.5(pid=19493): stderr: | [0;m[38;5;43m20221214120617391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120617391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120617391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120617391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120617399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120617400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120617400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:19.210284 run patchelf(pid=19496): Terminating (SIGINT) 12:06:19.380020 run patchelf(pid=19496): Terminated: ok {rc=0} 12:06:19.502410 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19493): Process ended prematurely: osmo-stp_10.42.42.5(pid=19493) [trial-2404↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19493)] [trial-2404↪gprs:trx-umtrx↪ping.py:22] 12:06:19.511251 tst ping.py:22: Test FAILED (6.8 sec) 12:06:19.538455 run osmo-hlr_10.42.42.2(pid=19490): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19490)] 12:06:19.587224 run osmo-hlr_10.42.42.2(pid=19490): stdout: | (launched: 2022-12-14_12:06:15.934483) 12:06:19.637100 run osmo-hlr_10.42.42.2(pid=19490): stderr: | [0;m[1;31m20221214120616248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120616248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120616248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120616248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120616248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120616248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120616268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120616296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120616296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120616296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:19.687251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19489): Terminating (SIGTERM) 12:06:19.727595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19492): Terminating (SIGTERM) 12:06:19.767830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19495): Terminating (SIGTERM) 12:06:19.808291 --- ParallelTerminationStrategy: PID 19489 died... 12:06:19.827958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19489): Terminated: ok {rc=0} 12:06:19.872257 --- ParallelTerminationStrategy: PID 19492 died... 12:06:19.891421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19492): Terminated: ok {rc=0} 12:06:19.935694 --- ParallelTerminationStrategy: PID 19495 died... 12:06:19.954696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19495): Terminated: ok {rc=0} 12:06:20.040840 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 12:06:21.128857 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:21.140232 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 12:06:21.189183 tst ping_idle_ping.py: using LAC 40782 12:06:21.310055 tst ping_idle_ping.py: using RAC 237 12:06:21.430946 tst ping_idle_ping.py: using CellId 40782 12:06:21.550893 tst ping_idle_ping.py: using BVCI 40783 12:06:21.662695 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:21.673876 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:21.684299 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:21.694722 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:21.705965 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:21.717164 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:21.728438 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 12:06:21.739879 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 12:06:21.861999 tst ping_idle_ping.py:24: start network... 12:06:22.082134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:22.588387 run create_hlr_db(pid=19497): Launched 12:06:22.722122 bus /gobi_6: Setting Powered False 12:06:23.786851 run create_hlr_db(pid=19497): Terminated: ok {rc=0} 12:06:24.241257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19499): Launched 12:06:24.569061 run osmo-hlr_10.42.42.2(pid=19500): Launched 12:06:24.694846 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:25.259499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19502): Launched 12:06:25.585226 run osmo-stp_10.42.42.5(pid=19503): Launched 12:06:25.710693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:26.272923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19505): Launched 12:06:26.398578 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:26.674532 run patchelf(pid=19506): Launched 12:06:26.855166 run osmo-stp_10.42.42.5(pid=19503): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19503)] 12:06:26.992773 run osmo-stp_10.42.42.5(pid=19503): stdout: | (launched: 2022-12-14_12:06:25.524034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:27.132120 run osmo-stp_10.42.42.5(pid=19503): stderr: | [0;m[38;5;43m20221214120625717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120625718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120625718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120625718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120625719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120625719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120625719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:27.271704 run osmo-stp_10.42.42.5(pid=19503): stdout: | (launched: 2022-12-14_12:06:25.524034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:27.404409 run osmo-stp_10.42.42.5(pid=19503): stderr: | [0;m[38;5;43m20221214120625717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120625718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120625718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120625718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120625719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120625719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120625719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:27.561815 run patchelf(pid=19506): Terminating (SIGINT) 12:06:27.744486 run patchelf(pid=19506): Terminated: ok {rc=0} 12:06:27.875461 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19503): Process ended prematurely: osmo-stp_10.42.42.5(pid=19503) [trial-2404↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19503)] [trial-2404↪gprs:trx-umtrx↪ping_idle_ping.py:27] 12:06:27.885126 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:06:27.913432 run osmo-hlr_10.42.42.2(pid=19500): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19500)] 12:06:27.963907 run osmo-hlr_10.42.42.2(pid=19500): stdout: | (launched: 2022-12-14_12:06:24.508449) 12:06:28.016287 run osmo-hlr_10.42.42.2(pid=19500): stderr: | [0;m[1;31m20221214120624708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120624708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120624708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120624709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120624709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120624709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120624722 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120624730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120624730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120624730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:28.068833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19499): Terminating (SIGTERM) 12:06:28.111247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19502): Terminating (SIGTERM) 12:06:28.154052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19505): Terminating (SIGTERM) 12:06:28.196556 --- ParallelTerminationStrategy: PID 19499 died... 12:06:28.217201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19499): Terminated: ok {rc=0} 12:06:28.263689 --- ParallelTerminationStrategy: PID 19502 died... 12:06:28.283641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19502): Terminated: ok {rc=0} 12:06:28.329913 --- ParallelTerminationStrategy: PID 19505 died... 12:06:28.350141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19505): Terminated: ok {rc=0} 12:06:28.440254 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 12:06:29.743027 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:06:29.748895 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:06:29.782286 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:06:29.822128 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:06:29.910393 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:06:29.943931 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:06:29.983668 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:06:30.577870 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:06:30.631671 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:30.643186 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:06:30.694248 tst cs_paging_gprs_active.py: using LAC 40783 12:06:30.823830 tst cs_paging_gprs_active.py: using RAC 238 12:06:30.956294 tst cs_paging_gprs_active.py: using CellId 40783 12:06:31.115264 tst cs_paging_gprs_active.py: using BVCI 40784 12:06:31.260774 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:31.273157 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:31.285199 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:31.297384 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:31.310531 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:31.323581 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:31.336802 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:31.351518 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:31.364326 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:06:31.490162 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:06:31.627851 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:06:31.860048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:32.201801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19510): Launched 12:06:32.501997 run iperf3-srv_10.42.42.10(pid=19511): Launched 12:06:32.626128 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:06:32.847868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:33.180094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19512): Launched 12:06:33.470228 run iperf3-srv_10.42.42.10(pid=19513): Launched 12:06:33.594363 tst cs_paging_gprs_active.py:38: start network... 12:06:33.817441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:34.330182 run create_hlr_db(pid=19514): Launched 12:06:34.466412 bus /gobi_6: Setting Powered False 12:06:35.531217 run create_hlr_db(pid=19514): Terminated: ok {rc=0} 12:06:35.973889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19516): Launched 12:06:36.282845 run osmo-hlr_10.42.42.2(pid=19517): Launched 12:06:36.402119 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:36.950070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19519): Launched 12:06:37.258540 run osmo-stp_10.42.42.5(pid=19520): Launched 12:06:37.378147 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:37.910283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19522): Launched 12:06:38.029537 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:38.290793 run patchelf(pid=19523): Launched 12:06:38.463929 run osmo-stp_10.42.42.5(pid=19520): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19520)] 12:06:38.594810 run osmo-stp_10.42.42.5(pid=19520): stdout: | (launched: 2022-12-14_12:06:37.200867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:38.727844 run osmo-stp_10.42.42.5(pid=19520): stderr: | [0;m[38;5;43m20221214120637373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120637373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120637373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120637374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120637374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120637374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120637374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:38.860168 run osmo-stp_10.42.42.5(pid=19520): stdout: | (launched: 2022-12-14_12:06:37.200867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:38.986572 run osmo-stp_10.42.42.5(pid=19520): stderr: | [0;m[38;5;43m20221214120637373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120637373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120637373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120637374 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120637374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120637374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120637374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:39.135835 run patchelf(pid=19523): Terminating (SIGINT) 12:06:39.309564 run patchelf(pid=19523): Terminated: ok {rc=0} 12:06:39.434227 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19520): Process ended prematurely: osmo-stp_10.42.42.5(pid=19520) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19520)] [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:06:39.443655 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:06:39.471043 run osmo-hlr_10.42.42.2(pid=19517): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19517)] 12:06:39.519688 run osmo-hlr_10.42.42.2(pid=19517): stdout: | (launched: 2022-12-14_12:06:36.225324) 12:06:39.569351 run osmo-hlr_10.42.42.2(pid=19517): stderr: | [0;m[1;31m20221214120636403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120636403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120636403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120636403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120636403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120636403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120636415 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120636423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120636423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120636423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:39.619513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19510): Terminating (SIGTERM) 12:06:39.659683 run iperf3-srv_10.42.42.10(pid=19511): Terminating (SIGTERM) 12:06:39.699927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19512): Terminating (SIGTERM) 12:06:39.740650 run iperf3-srv_10.42.42.10(pid=19513): Terminating (SIGTERM) 12:06:39.781262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19516): Terminating (SIGTERM) 12:06:39.821733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19519): Terminating (SIGTERM) 12:06:39.861986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19522): Terminating (SIGTERM) 12:06:39.903142 --- ParallelTerminationStrategy: PID 19510 died... 12:06:39.922866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19510): Terminated: ok {rc=0} 12:06:39.967465 --- ParallelTerminationStrategy: PID 19511 died... 12:06:39.986464 run iperf3-srv_10.42.42.10(pid=19511): Terminated {rc=256} 12:06:40.030535 --- ParallelTerminationStrategy: PID 19512 died... 12:06:40.049612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19512): Terminated: ok {rc=0} 12:06:40.093705 --- ParallelTerminationStrategy: PID 19513 died... 12:06:40.112751 run iperf3-srv_10.42.42.10(pid=19513): Terminated {rc=256} 12:06:40.156539 --- ParallelTerminationStrategy: PID 19516 died... 12:06:40.175597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19516): Terminated: ok {rc=0} 12:06:40.219677 --- ParallelTerminationStrategy: PID 19519 died... 12:06:40.238707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19519): Terminated: ok {rc=0} 12:06:40.282786 --- ParallelTerminationStrategy: PID 19522 died... 12:06:40.301890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19522): Terminated: ok {rc=0} 12:06:40.388199 bus /gobi_0: Setting Powered False 12:06:41.487113 bus /gobi_0: Setting Powered False 12:06:42.602519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:06:43.750491 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:43.762265 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:06:43.814582 tst iperf3.py: using LAC 40784 12:06:43.938258 tst iperf3.py: using RAC 239 12:06:44.061112 tst iperf3.py: using CellId 40784 12:06:44.191981 tst iperf3.py: using BVCI 40785 12:06:44.306173 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:44.317280 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:44.328129 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:44.339005 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:44.350878 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:44.362017 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:44.373225 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:44.383962 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:44.395330 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:06:44.512070 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:06:44.720416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:45.031867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19524): Launched 12:06:45.305049 run iperf3-srv_10.42.42.10(pid=19525): Launched 12:06:45.420822 tst iperf3.py:8: start network... 12:06:45.627931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:46.165751 run create_hlr_db(pid=19526): Launched 12:06:46.334839 bus /gobi_6: Setting Powered False 12:06:47.399409 run create_hlr_db(pid=19526): Terminated: ok {rc=0} 12:06:47.844788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19528): Launched 12:06:48.153970 run osmo-hlr_10.42.42.2(pid=19529): Launched 12:06:48.272222 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:48.823907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19531): Launched 12:06:49.134958 run osmo-stp_10.42.42.5(pid=19532): Launched 12:06:49.253853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:49.783153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19534): Launched 12:06:49.903041 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:50.163941 run patchelf(pid=19535): Launched 12:06:50.336140 run osmo-stp_10.42.42.5(pid=19532): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19532)] 12:06:50.466498 run osmo-stp_10.42.42.5(pid=19532): stdout: | (launched: 2022-12-14_12:06:49.077127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:50.598537 run osmo-stp_10.42.42.5(pid=19532): stderr: | [0;m[38;5;43m20221214120649250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120649250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120649250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120649250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120649251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120649251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120649251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:50.730545 run osmo-stp_10.42.42.5(pid=19532): stdout: | (launched: 2022-12-14_12:06:49.077127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:50.856304 run osmo-stp_10.42.42.5(pid=19532): stderr: | [0;m[38;5;43m20221214120649250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120649250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120649250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120649250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120649251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120649251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120649251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:51.005052 run patchelf(pid=19535): Terminating (SIGINT) 12:06:51.177393 run patchelf(pid=19535): Terminated: ok {rc=0} 12:06:51.301600 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19532): Process ended prematurely: osmo-stp_10.42.42.5(pid=19532) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19532)] [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 12:06:51.311123 tst iperf3.py:8: Test FAILED (7.6 sec) 12:06:51.338498 run osmo-hlr_10.42.42.2(pid=19529): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19529)] 12:06:51.387117 run osmo-hlr_10.42.42.2(pid=19529): stdout: | (launched: 2022-12-14_12:06:48.096213) 12:06:51.437870 run osmo-hlr_10.42.42.2(pid=19529): stderr: | [0;m[1;31m20221214120648275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120648275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120648275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120648275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120648275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120648275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120648287 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120648296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120648296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120648296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:51.487961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19524): Terminating (SIGTERM) 12:06:51.528468 run iperf3-srv_10.42.42.10(pid=19525): Terminating (SIGTERM) 12:06:51.569325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19528): Terminating (SIGTERM) 12:06:51.609650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19531): Terminating (SIGTERM) 12:06:51.650186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19534): Terminating (SIGTERM) 12:06:51.690864 --- ParallelTerminationStrategy: PID 19524 died... 12:06:51.710366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19524): Terminated: ok {rc=0} 12:06:51.754747 --- ParallelTerminationStrategy: PID 19525 died... 12:06:51.773771 run iperf3-srv_10.42.42.10(pid=19525): Terminated {rc=256} 12:06:51.818315 --- ParallelTerminationStrategy: PID 19528 died... 12:06:51.837485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19528): Terminated: ok {rc=0} 12:06:51.881807 --- ParallelTerminationStrategy: PID 19531 died... 12:06:51.900880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19531): Terminated: ok {rc=0} 12:06:51.945375 --- ParallelTerminationStrategy: PID 19534 died... 12:06:51.964438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19534): Terminated: ok {rc=0} 12:06:52.051161 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:06:53.200620 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:53.212138 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:06:53.264836 tst iperf3m4.py: using LAC 40785 12:06:53.386739 tst iperf3m4.py: using RAC 240 12:06:53.507572 tst iperf3m4.py: using CellId 40785 12:06:53.627259 tst iperf3m4.py: using BVCI 40786 12:06:53.740904 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:53.751974 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:53.762679 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:53.773300 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:53.784684 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:53.796090 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:53.807858 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:53.819250 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:06:53.830887 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:06:53.956218 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:06:54.078414 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:06:54.198594 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:06:54.318172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:06:54.525347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:54.835781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19536): Launched 12:06:55.107975 run iperf3-srv_10.42.42.10(pid=19537): Launched 12:06:55.224939 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:06:55.431168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:55.742190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19538): Launched 12:06:56.014368 run iperf3-srv_10.42.42.10(pid=19539): Launched 12:06:56.131599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:06:56.337457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:56.647998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19540): Launched 12:06:56.919998 run iperf3-srv_10.42.42.10(pid=19541): Launched 12:06:57.036529 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:06:57.242028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:57.551778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19542): Launched 12:06:57.821238 run iperf3-srv_10.42.42.10(pid=19543): Launched 12:06:57.937147 tst iperf3m4.py:8: start network... 12:06:58.142684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:58.620122 run create_hlr_db(pid=19544): Launched 12:06:58.739037 bus /gobi_6: Setting Powered False 12:06:59.800074 run create_hlr_db(pid=19544): Terminated: ok {rc=0} 12:07:00.253666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19546): Launched 12:07:00.586379 run osmo-hlr_10.42.42.2(pid=19547): Launched 12:07:00.713567 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:01.349235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19549): Launched 12:07:01.697065 run osmo-stp_10.42.42.5(pid=19550): Launched 12:07:01.913162 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:02.628250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19552): Launched 12:07:02.755207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:03.035917 run patchelf(pid=19553): Launched 12:07:03.221652 run osmo-stp_10.42.42.5(pid=19550): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19550)] 12:07:03.361609 run osmo-stp_10.42.42.5(pid=19550): stdout: | (launched: 2022-12-14_12:07:01.635286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:03.506993 run osmo-stp_10.42.42.5(pid=19550): stderr: | [0;m[38;5;43m20221214120701953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120701953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120701953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120701954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120701954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120701954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120701954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:03.649207 run osmo-stp_10.42.42.5(pid=19550): stdout: | (launched: 2022-12-14_12:07:01.635286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:03.784563 run osmo-stp_10.42.42.5(pid=19550): stderr: | [0;m[38;5;43m20221214120701953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120701953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120701953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120701954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120701954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120701954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120701954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:03.946120 run patchelf(pid=19553): Terminating (SIGINT) 12:07:04.131367 run patchelf(pid=19553): Terminated: ok {rc=0} 12:07:04.265138 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19550): Process ended prematurely: osmo-stp_10.42.42.5(pid=19550) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19550)] [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 12:07:04.275689 tst iperf3m4.py:8: Test FAILED (11.1 sec) 12:07:04.304883 run osmo-hlr_10.42.42.2(pid=19547): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19547)] 12:07:04.355825 run osmo-hlr_10.42.42.2(pid=19547): stdout: | (launched: 2022-12-14_12:07:00.525033) 12:07:04.408431 run osmo-hlr_10.42.42.2(pid=19547): stderr: | [0;m[1;31m20221214120700723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120700723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120700723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120700723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120700724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120700724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120700741 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120700750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120700750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120700750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:04.461057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19536): Terminating (SIGTERM) 12:07:04.503238 run iperf3-srv_10.42.42.10(pid=19537): Terminating (SIGTERM) 12:07:04.545898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19538): Terminating (SIGTERM) 12:07:04.588147 run iperf3-srv_10.42.42.10(pid=19539): Terminating (SIGTERM) 12:07:04.631152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19540): Terminating (SIGTERM) 12:07:04.673827 run iperf3-srv_10.42.42.10(pid=19541): Terminating (SIGTERM) 12:07:04.715965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19542): Terminating (SIGTERM) 12:07:04.758556 run iperf3-srv_10.42.42.10(pid=19543): Terminating (SIGTERM) 12:07:04.800705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19546): Terminating (SIGTERM) 12:07:04.843147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19549): Terminating (SIGTERM) 12:07:04.885469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19552): Terminating (SIGTERM) 12:07:04.928059 --- ParallelTerminationStrategy: PID 19536 died... 12:07:04.948419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19536): Terminated: ok {rc=0} 12:07:04.994795 --- ParallelTerminationStrategy: PID 19537 died... 12:07:05.014514 run iperf3-srv_10.42.42.10(pid=19537): Terminated {rc=256} 12:07:05.060588 --- ParallelTerminationStrategy: PID 19538 died... 12:07:05.080362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19538): Terminated: ok {rc=0} 12:07:05.126714 --- ParallelTerminationStrategy: PID 19539 died... 12:07:05.146367 run iperf3-srv_10.42.42.10(pid=19539): Terminated {rc=256} 12:07:05.192753 --- ParallelTerminationStrategy: PID 19540 died... 12:07:05.212607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19540): Terminated: ok {rc=0} 12:07:05.258949 --- ParallelTerminationStrategy: PID 19541 died... 12:07:05.278694 run iperf3-srv_10.42.42.10(pid=19541): Terminated {rc=256} 12:07:05.325209 --- ParallelTerminationStrategy: PID 19542 died... 12:07:05.344907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19542): Terminated: ok {rc=0} 12:07:05.391232 --- ParallelTerminationStrategy: PID 19543 died... 12:07:05.411102 run iperf3-srv_10.42.42.10(pid=19543): Terminated {rc=256} 12:07:05.457287 --- ParallelTerminationStrategy: PID 19546 died... 12:07:05.476897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19546): Terminated: ok {rc=0} 12:07:05.523574 --- ParallelTerminationStrategy: PID 19549 died... 12:07:05.543460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19549): Terminated: ok {rc=0} 12:07:05.589949 --- ParallelTerminationStrategy: PID 19552 died... 12:07:05.610059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19552): Terminated: ok {rc=0} 12:07:05.698870 bus /gobi_4: Setting Powered False 12:07:06.798835 bus /gobi_4: Setting Powered False 12:07:07.915676 bus /gobi_1: Setting Powered False 12:07:09.014896 bus /gobi_1: Setting Powered False 12:07:10.131984 bus /gobi_0: Setting Powered False 12:07:11.230758 bus /gobi_0: Setting Powered False 12:07:12.349579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 12:07:13.455921 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:13.467979 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:07:13.519354 tst ping.py: using LAC 40786 12:07:13.648410 tst ping.py: using RAC 241 12:07:13.775296 tst ping.py: using CellId 40786 12:07:13.903013 tst ping.py: using BVCI 40787 12:07:14.021433 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:14.032772 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:14.044063 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:14.055241 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:14.066359 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:14.077488 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:14.088735 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:14.099989 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:07:14.216519 tst ping.py:19: start network... 12:07:14.442436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:14.944589 run create_hlr_db(pid=19554): Launched 12:07:15.077096 bus /gobi_6: Setting Powered False 12:07:16.140821 run create_hlr_db(pid=19554): Terminated: ok {rc=0} 12:07:16.602546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19556): Launched 12:07:16.941387 run osmo-hlr_10.42.42.2(pid=19557): Launched 12:07:17.168454 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:17.735103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19559): Launched 12:07:18.059272 run osmo-stp_10.42.42.5(pid=19560): Launched 12:07:18.182010 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:18.740499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19562): Launched 12:07:18.865266 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:19.139269 run patchelf(pid=19563): Launched 12:07:19.320341 run osmo-stp_10.42.42.5(pid=19560): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19560)] 12:07:19.457199 run osmo-stp_10.42.42.5(pid=19560): stdout: | (launched: 2022-12-14_12:07:17.998736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:19.595755 run osmo-stp_10.42.42.5(pid=19560): stderr: | [0;m[38;5;43m20221214120718193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120718193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120718193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120718194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:19.734768 run osmo-stp_10.42.42.5(pid=19560): stdout: | (launched: 2022-12-14_12:07:17.998736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:19.866911 run osmo-stp_10.42.42.5(pid=19560): stderr: | [0;m[38;5;43m20221214120718193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120718193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120718193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120718194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:20.023732 run patchelf(pid=19563): Terminating (SIGINT) 12:07:20.205585 run patchelf(pid=19563): Terminated: ok {rc=0} 12:07:20.335660 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19560): Process ended prematurely: osmo-stp_10.42.42.5(pid=19560) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19560)] [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 12:07:20.345326 tst ping.py:22: Test FAILED (6.9 sec) 12:07:20.373264 run osmo-hlr_10.42.42.2(pid=19557): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19557)] 12:07:20.423707 run osmo-hlr_10.42.42.2(pid=19557): stdout: | (launched: 2022-12-14_12:07:16.881289) 12:07:20.475578 run osmo-hlr_10.42.42.2(pid=19557): stderr: | [0;m[1;31m20221214120717168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120717168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120717168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120717168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120717168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120717168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120717181 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120717189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120717189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120717189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:20.527707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19556): Terminating (SIGTERM) 12:07:20.569900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19559): Terminating (SIGTERM) 12:07:20.612558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19562): Terminating (SIGTERM) 12:07:20.655695 --- ParallelTerminationStrategy: PID 19556 died... 12:07:20.676229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19556): Terminated: ok {rc=0} 12:07:20.722671 --- ParallelTerminationStrategy: PID 19559 died... 12:07:20.742474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19559): Terminated: ok {rc=0} 12:07:20.788603 --- ParallelTerminationStrategy: PID 19562 died... 12:07:20.808450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19562): Terminated: ok {rc=0} 12:07:20.896827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:07:21.982630 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:21.994984 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:07:22.047373 tst ping_idle_ping.py: using LAC 40787 12:07:22.194079 tst ping_idle_ping.py: using RAC 242 12:07:22.318791 tst ping_idle_ping.py: using CellId 40787 12:07:22.444202 tst ping_idle_ping.py: using BVCI 40788 12:07:22.558728 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:22.570179 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:22.581417 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:22.592552 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:22.604136 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:22.615398 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:22.626845 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:22.638158 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:07:22.756560 tst ping_idle_ping.py:24: start network... 12:07:22.970107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:23.462286 run create_hlr_db(pid=19564): Launched 12:07:23.590572 bus /gobi_6: Setting Powered False 12:07:24.654119 run create_hlr_db(pid=19564): Terminated: ok {rc=0} 12:07:25.097730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19566): Launched 12:07:25.416649 run osmo-hlr_10.42.42.2(pid=19567): Launched 12:07:25.537111 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:26.086920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19569): Launched 12:07:26.403303 run osmo-stp_10.42.42.5(pid=19570): Launched 12:07:26.523292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:27.070310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19572): Launched 12:07:27.193886 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:27.462249 run patchelf(pid=19573): Launched 12:07:27.639198 run osmo-stp_10.42.42.5(pid=19570): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19570)] 12:07:27.774364 run osmo-stp_10.42.42.5(pid=19570): stdout: | (launched: 2022-12-14_12:07:26.344890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:27.911098 run osmo-stp_10.42.42.5(pid=19570): stderr: | [0;m[38;5;43m20221214120726533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120726533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120726533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120726534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120726534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120726534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120726534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:28.048062 run osmo-stp_10.42.42.5(pid=19570): stdout: | (launched: 2022-12-14_12:07:26.344890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:28.179193 run osmo-stp_10.42.42.5(pid=19570): stderr: | [0;m[38;5;43m20221214120726533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120726533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120726533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120726534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120726534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120726534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120726534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:28.333534 run patchelf(pid=19573): Terminating (SIGINT) 12:07:28.512675 run patchelf(pid=19573): Terminated: ok {rc=0} 12:07:28.641776 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19570): Process ended prematurely: osmo-stp_10.42.42.5(pid=19570) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19570)] [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 12:07:28.651424 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:07:28.679587 run osmo-hlr_10.42.42.2(pid=19567): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19567)] 12:07:28.729658 run osmo-hlr_10.42.42.2(pid=19567): stdout: | (launched: 2022-12-14_12:07:25.358034) 12:07:28.781297 run osmo-hlr_10.42.42.2(pid=19567): stderr: | [0;m[1;31m20221214120725555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120725555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120725555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120725555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120725555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120725555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120725567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120725575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120725575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120725575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:28.833661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19566): Terminating (SIGTERM) 12:07:28.875630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19569): Terminating (SIGTERM) 12:07:28.918010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19572): Terminating (SIGTERM) 12:07:28.960239 --- ParallelTerminationStrategy: PID 19566 died... 12:07:28.980547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19566): Terminated: ok {rc=0} 12:07:29.026815 --- ParallelTerminationStrategy: PID 19569 died... 12:07:29.046424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19569): Terminated: ok {rc=0} 12:07:29.092567 --- ParallelTerminationStrategy: PID 19572 died... 12:07:29.112495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19572): Terminated: ok {rc=0} 12:07:29.199654 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:07:30.502696 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:07:30.509265 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:07:30.541911 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:07:30.582448 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:07:30.668628 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:07:30.701479 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:07:30.740485 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:07:31.369556 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:07:31.431575 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:31.446966 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:07:31.529781 tst cs_paging_gprs_active.py: using LAC 40788 12:07:31.653757 tst cs_paging_gprs_active.py: using RAC 243 12:07:31.777697 tst cs_paging_gprs_active.py: using CellId 40788 12:07:31.936052 tst cs_paging_gprs_active.py: using BVCI 40789 12:07:32.056587 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:32.068780 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:32.080926 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:32.093173 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:32.105821 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:32.118398 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:32.131200 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:32.143741 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:32.156417 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:07:32.281965 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:07:32.400868 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:07:32.603476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:32.905839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19578): Launched 12:07:33.169362 run iperf3-srv_10.42.42.10(pid=19579): Launched 12:07:33.282379 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:07:33.482994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:33.785041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19580): Launched 12:07:34.047354 run iperf3-srv_10.42.42.10(pid=19581): Launched 12:07:34.160714 tst cs_paging_gprs_active.py:38: start network... 12:07:34.361393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:34.825826 run create_hlr_db(pid=19582): Launched 12:07:34.940022 bus /gobi_6: Setting Powered False 12:07:36.000627 run create_hlr_db(pid=19582): Terminated: ok {rc=0} 12:07:36.442207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19584): Launched 12:07:36.764360 run osmo-hlr_10.42.42.2(pid=19585): Launched 12:07:36.885799 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:37.438763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19587): Launched 12:07:37.760485 run osmo-stp_10.42.42.5(pid=19588): Launched 12:07:37.882912 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:38.438939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19590): Launched 12:07:38.562355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:38.842789 run patchelf(pid=19591): Launched 12:07:39.024050 run osmo-stp_10.42.42.5(pid=19588): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19588)] 12:07:39.161880 run osmo-stp_10.42.42.5(pid=19588): stdout: | (launched: 2022-12-14_12:07:37.701277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:39.301750 run osmo-stp_10.42.42.5(pid=19588): stderr: | [0;m[38;5;43m20221214120737888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120737889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120737889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120737889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120737890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120737890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120737890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:39.441804 run osmo-stp_10.42.42.5(pid=19588): stdout: | (launched: 2022-12-14_12:07:37.701277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:39.575666 run osmo-stp_10.42.42.5(pid=19588): stderr: | [0;m[38;5;43m20221214120737888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120737889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120737889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120737889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120737890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120737890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120737890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:39.734842 run patchelf(pid=19591): Terminating (SIGINT) 12:07:39.917446 run patchelf(pid=19591): Terminated: ok {rc=0} 12:07:40.050073 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19588): Process ended prematurely: osmo-stp_10.42.42.5(pid=19588) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19588)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:07:40.060205 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:07:40.088766 run osmo-hlr_10.42.42.2(pid=19585): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19585)] 12:07:40.138714 run osmo-hlr_10.42.42.2(pid=19585): stdout: | (launched: 2022-12-14_12:07:36.705078) 12:07:40.190351 run osmo-hlr_10.42.42.2(pid=19585): stderr: | [0;m[1;31m20221214120736898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120736898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120736899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120736899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120736899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120736899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120736911 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120736919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120736920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120736920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:40.242319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19578): Terminating (SIGTERM) 12:07:40.283894 run iperf3-srv_10.42.42.10(pid=19579): Terminating (SIGTERM) 12:07:40.326091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19580): Terminating (SIGTERM) 12:07:40.367971 run iperf3-srv_10.42.42.10(pid=19581): Terminating (SIGTERM) 12:07:40.409947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19584): Terminating (SIGTERM) 12:07:40.451931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19587): Terminating (SIGTERM) 12:07:40.493746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19590): Terminating (SIGTERM) 12:07:40.536018 --- ParallelTerminationStrategy: PID 19578 died... 12:07:40.556187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19578): Terminated: ok {rc=0} 12:07:40.602246 --- ParallelTerminationStrategy: PID 19579 died... 12:07:40.622163 run iperf3-srv_10.42.42.10(pid=19579): Terminated {rc=256} 12:07:40.667871 --- ParallelTerminationStrategy: PID 19580 died... 12:07:40.687533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19580): Terminated: ok {rc=0} 12:07:40.732937 --- ParallelTerminationStrategy: PID 19581 died... 12:07:40.752311 run iperf3-srv_10.42.42.10(pid=19581): Terminated {rc=256} 12:07:40.798014 --- ParallelTerminationStrategy: PID 19584 died... 12:07:40.817623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19584): Terminated: ok {rc=0} 12:07:40.863496 --- ParallelTerminationStrategy: PID 19587 died... 12:07:40.883038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19587): Terminated: ok {rc=0} 12:07:40.928797 --- ParallelTerminationStrategy: PID 19590 died... 12:07:40.948902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19590): Terminated: ok {rc=0} 12:07:41.035238 bus /gobi_0: Setting Powered False 12:07:42.134640 bus /gobi_0: Setting Powered False 12:07:43.250891 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:07:44.399944 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:44.411903 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:07:44.482250 tst iperf3.py: using LAC 40789 12:07:44.610706 tst iperf3.py: using RAC 244 12:07:44.737848 tst iperf3.py: using CellId 40789 12:07:44.865063 tst iperf3.py: using BVCI 40790 12:07:44.982897 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:44.994257 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:45.005408 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:45.016360 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:45.027378 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:45.038513 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:45.049700 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:45.060626 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:45.071861 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:07:45.188882 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:07:45.392786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:45.698755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19593): Launched 12:07:45.981854 run iperf3-srv_10.42.42.10(pid=19594): Launched 12:07:46.106172 tst iperf3.py:8: start network... 12:07:46.316435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:46.811674 run create_hlr_db(pid=19595): Launched 12:07:46.959385 bus /gobi_6: Setting Powered False 12:07:48.019521 run create_hlr_db(pid=19595): Terminated: ok {rc=0} 12:07:48.442708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19597): Launched 12:07:48.746315 run osmo-hlr_10.42.42.2(pid=19598): Launched 12:07:48.860753 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:49.490868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19600): Launched 12:07:49.786683 run osmo-stp_10.42.42.5(pid=19601): Launched 12:07:49.898389 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:50.410199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19603): Launched 12:07:50.523323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:50.774806 run patchelf(pid=19604): Launched 12:07:50.939961 run osmo-stp_10.42.42.5(pid=19601): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19601)] 12:07:51.066039 run osmo-stp_10.42.42.5(pid=19601): stdout: | (launched: 2022-12-14_12:07:49.731421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:51.193911 run osmo-stp_10.42.42.5(pid=19601): stderr: | [0;m[38;5;43m20221214120749897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120749897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120749897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120749898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120749898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120749898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120749898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:51.321386 run osmo-stp_10.42.42.5(pid=19601): stdout: | (launched: 2022-12-14_12:07:49.731421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:51.443500 run osmo-stp_10.42.42.5(pid=19601): stderr: | [0;m[38;5;43m20221214120749897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120749897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120749897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120749898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120749898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120749898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120749898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:51.587572 run patchelf(pid=19604): Terminating (SIGINT) 12:07:51.754444 run patchelf(pid=19604): Terminated: ok {rc=0} 12:07:51.874930 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19601): Process ended prematurely: osmo-stp_10.42.42.5(pid=19601) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19601)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 12:07:51.884407 tst iperf3.py:8: Test FAILED (7.5 sec) 12:07:51.911438 run osmo-hlr_10.42.42.2(pid=19598): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19598)] 12:07:51.959195 run osmo-hlr_10.42.42.2(pid=19598): stdout: | (launched: 2022-12-14_12:07:48.689665) 12:07:52.008580 run osmo-hlr_10.42.42.2(pid=19598): stderr: | [0;m[1;31m20221214120748864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120748864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120748864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120748864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120748864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120748864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120748876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120748885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120748886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120748886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:52.058171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19593): Terminating (SIGTERM) 12:07:52.097924 run iperf3-srv_10.42.42.10(pid=19594): Terminating (SIGTERM) 12:07:52.137762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19597): Terminating (SIGTERM) 12:07:52.177339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19600): Terminating (SIGTERM) 12:07:52.217648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19603): Terminating (SIGTERM) 12:07:52.258313 --- ParallelTerminationStrategy: PID 19593 died... 12:07:52.277702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19593): Terminated: ok {rc=0} 12:07:52.321618 --- ParallelTerminationStrategy: PID 19594 died... 12:07:52.340265 run iperf3-srv_10.42.42.10(pid=19594): Terminated {rc=256} 12:07:52.384253 --- ParallelTerminationStrategy: PID 19597 died... 12:07:52.403228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19597): Terminated: ok {rc=0} 12:07:52.447109 --- ParallelTerminationStrategy: PID 19600 died... 12:07:52.465875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19600): Terminated: ok {rc=0} 12:07:52.509593 --- ParallelTerminationStrategy: PID 19603 died... 12:07:52.528231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19603): Terminated: ok {rc=0} 12:07:52.611931 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:07:53.759674 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:53.771498 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:07:53.841577 tst iperf3m4.py: using LAC 40790 12:07:53.964431 tst iperf3m4.py: using RAC 245 12:07:54.081563 tst iperf3m4.py: using CellId 40790 12:07:54.206259 tst iperf3m4.py: using BVCI 40791 12:07:54.321192 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:54.332358 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:54.343522 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:54.354990 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:54.366065 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:54.377069 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:54.388169 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:54.399107 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:07:54.410314 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:07:54.526530 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:07:54.642986 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:07:54.762132 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:07:54.878219 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:07:55.075085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:55.371443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19605): Launched 12:07:55.628456 run iperf3-srv_10.42.42.10(pid=19606): Launched 12:07:55.738700 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:07:55.935202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:56.231494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19607): Launched 12:07:56.488603 run iperf3-srv_10.42.42.10(pid=19608): Launched 12:07:56.598876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:07:56.795428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:57.092061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19609): Launched 12:07:57.350277 run iperf3-srv_10.42.42.10(pid=19610): Launched 12:07:57.460129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:07:57.656701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:57.953088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19611): Launched 12:07:58.210965 run iperf3-srv_10.42.42.10(pid=19612): Launched 12:07:58.321864 tst iperf3m4.py:8: start network... 12:07:58.519139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:58.979378 run create_hlr_db(pid=19613): Launched 12:07:59.093369 bus /gobi_6: Setting Powered False 12:08:00.152321 run create_hlr_db(pid=19613): Terminated: ok {rc=0} 12:08:00.588326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19615): Launched 12:08:00.910799 run osmo-hlr_10.42.42.2(pid=19617): Launched 12:08:01.166074 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:01.747079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19619): Launched 12:08:02.069752 run osmo-stp_10.42.42.5(pid=19620): Launched 12:08:02.292037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:02.862645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19622): Launched 12:08:02.983729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:03.257687 run patchelf(pid=19623): Launched 12:08:03.433640 run osmo-stp_10.42.42.5(pid=19620): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19620)] 12:08:03.568500 run osmo-stp_10.42.42.5(pid=19620): stdout: | (launched: 2022-12-14_12:08:02.008773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:03.705175 run osmo-stp_10.42.42.5(pid=19620): stderr: | [0;m[38;5;43m20221214120802332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120802332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120802332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120802333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120802333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120802333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120802333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:03.841486 run osmo-stp_10.42.42.5(pid=19620): stdout: | (launched: 2022-12-14_12:08:02.008773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:03.971771 run osmo-stp_10.42.42.5(pid=19620): stderr: | [0;m[38;5;43m20221214120802332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120802332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120802332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120802333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120802333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120802333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120802333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:04.126499 run patchelf(pid=19623): Terminating (SIGINT) 12:08:04.304548 run patchelf(pid=19623): Terminated: ok {rc=0} 12:08:04.433869 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19620): Process ended prematurely: osmo-stp_10.42.42.5(pid=19620) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19620)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:08:04.444031 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:08:04.472653 run osmo-hlr_10.42.42.2(pid=19617): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19617)] 12:08:04.522269 run osmo-hlr_10.42.42.2(pid=19617): stdout: | (launched: 2022-12-14_12:08:00.851766) 12:08:04.573578 run osmo-hlr_10.42.42.2(pid=19617): stderr: | [0;m[1;31m20221214120801152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120801152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120801152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120801152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120801153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120801153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120801173 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120801189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120801189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120801189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:04.625845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19605): Terminating (SIGTERM) 12:08:04.667721 run iperf3-srv_10.42.42.10(pid=19606): Terminating (SIGTERM) 12:08:04.710127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19607): Terminating (SIGTERM) 12:08:04.751819 run iperf3-srv_10.42.42.10(pid=19608): Terminating (SIGTERM) 12:08:04.794041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19609): Terminating (SIGTERM) 12:08:04.835579 run iperf3-srv_10.42.42.10(pid=19610): Terminating (SIGTERM) 12:08:04.877002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19611): Terminating (SIGTERM) 12:08:04.919082 run iperf3-srv_10.42.42.10(pid=19612): Terminating (SIGTERM) 12:08:04.960532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19615): Terminating (SIGTERM) 12:08:05.002042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19619): Terminating (SIGTERM) 12:08:05.043435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19622): Terminating (SIGTERM) 12:08:05.085316 --- ParallelTerminationStrategy: PID 19605 died... 12:08:05.105287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19605): Terminated: ok {rc=0} 12:08:05.151169 --- ParallelTerminationStrategy: PID 19606 died... 12:08:05.170613 run iperf3-srv_10.42.42.10(pid=19606): Terminated {rc=256} 12:08:05.216483 --- ParallelTerminationStrategy: PID 19607 died... 12:08:05.235813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19607): Terminated: ok {rc=0} 12:08:05.281431 --- ParallelTerminationStrategy: PID 19608 died... 12:08:05.300705 run iperf3-srv_10.42.42.10(pid=19608): Terminated {rc=256} 12:08:05.346191 --- ParallelTerminationStrategy: PID 19609 died... 12:08:05.365504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19609): Terminated: ok {rc=0} 12:08:05.411248 --- ParallelTerminationStrategy: PID 19610 died... 12:08:05.430617 run iperf3-srv_10.42.42.10(pid=19610): Terminated {rc=256} 12:08:05.476031 --- ParallelTerminationStrategy: PID 19611 died... 12:08:05.495607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19611): Terminated: ok {rc=0} 12:08:05.541354 --- ParallelTerminationStrategy: PID 19612 died... 12:08:05.560633 run iperf3-srv_10.42.42.10(pid=19612): Terminated {rc=256} 12:08:05.606372 --- ParallelTerminationStrategy: PID 19615 died... 12:08:05.625942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19615): Terminated: ok {rc=0} 12:08:05.671004 --- ParallelTerminationStrategy: PID 19619 died... 12:08:05.690403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19619): Terminated: ok {rc=0} 12:08:05.735910 --- ParallelTerminationStrategy: PID 19622 died... 12:08:05.755464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19622): Terminated: ok {rc=0} 12:08:05.842003 bus /gobi_4: Setting Powered False 12:08:06.940277 bus /gobi_4: Setting Powered False 12:08:08.056908 bus /gobi_1: Setting Powered False 12:08:09.154841 bus /gobi_1: Setting Powered False 12:08:10.270354 bus /gobi_0: Setting Powered False 12:08:11.368202 bus /gobi_0: Setting Powered False 12:08:12.483942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:08:13.586229 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:13.598236 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:08:13.687953 tst ping.py: using LAC 40791 12:08:13.811880 tst ping.py: using RAC 246 12:08:13.933957 tst ping.py: using CellId 40791 12:08:14.057319 tst ping.py: using BVCI 40792 12:08:14.170712 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:14.182088 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:14.193270 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:14.204299 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:14.215628 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:14.226832 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:14.238060 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:14.249210 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:08:14.366287 tst ping.py:19: start network... 12:08:14.577301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:15.064584 run create_hlr_db(pid=19624): Launched 12:08:15.191776 bus /gobi_6: Setting Powered False 12:08:16.252091 run create_hlr_db(pid=19624): Terminated: ok {rc=0} 12:08:16.710282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19626): Launched 12:08:17.053667 run osmo-hlr_10.42.42.2(pid=19627): Launched 12:08:17.270024 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:17.819043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19629): Launched 12:08:18.133517 run osmo-stp_10.42.42.5(pid=19630): Launched 12:08:18.252735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:18.798214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19632): Launched 12:08:18.917321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:19.181763 run patchelf(pid=19633): Launched 12:08:19.356791 run osmo-stp_10.42.42.5(pid=19630): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19630)] 12:08:19.489816 run osmo-stp_10.42.42.5(pid=19630): stdout: | (launched: 2022-12-14_12:08:18.075939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:19.624090 run osmo-stp_10.42.42.5(pid=19630): stderr: | [0;m[38;5;43m20221214120818268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120818268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120818268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120818269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120818269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120818269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120818269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:19.759180 run osmo-stp_10.42.42.5(pid=19630): stdout: | (launched: 2022-12-14_12:08:18.075939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:19.886828 run osmo-stp_10.42.42.5(pid=19630): stderr: | [0;m[38;5;43m20221214120818268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120818268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120818268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120818269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120818269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120818269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120818269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:20.038520 run patchelf(pid=19633): Terminating (SIGINT) 12:08:20.214234 run patchelf(pid=19633): Terminated: ok {rc=0} 12:08:20.340441 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19630): Process ended prematurely: osmo-stp_10.42.42.5(pid=19630) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19630)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 12:08:20.350089 tst ping.py:22: Test FAILED (6.8 sec) 12:08:20.377743 run osmo-hlr_10.42.42.2(pid=19627): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19627)] 12:08:20.427391 run osmo-hlr_10.42.42.2(pid=19627): stdout: | (launched: 2022-12-14_12:08:16.991208) 12:08:20.478651 run osmo-hlr_10.42.42.2(pid=19627): stderr: | [0;m[1;31m20221214120817233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120817233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120817233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120817233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120817233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120817234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120817248 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120817265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120817265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120817265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:20.530892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19626): Terminating (SIGTERM) 12:08:20.572544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19629): Terminating (SIGTERM) 12:08:20.614801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19632): Terminating (SIGTERM) 12:08:20.656747 --- ParallelTerminationStrategy: PID 19626 died... 12:08:20.676576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19626): Terminated: ok {rc=0} 12:08:20.722122 --- ParallelTerminationStrategy: PID 19629 died... 12:08:20.741270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19629): Terminated: ok {rc=0} 12:08:20.786470 --- ParallelTerminationStrategy: PID 19632 died... 12:08:20.805748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19632): Terminated: ok {rc=0} 12:08:20.892299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:08:21.978591 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:21.990453 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:08:22.064413 tst ping_idle_ping.py: using LAC 40792 12:08:22.188800 tst ping_idle_ping.py: using RAC 247 12:08:22.310970 tst ping_idle_ping.py: using CellId 40792 12:08:22.433599 tst ping_idle_ping.py: using BVCI 40793 12:08:22.548795 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:22.560133 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:22.571249 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:22.582424 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:22.593541 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:22.604569 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:22.615777 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:22.626890 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:08:22.742154 tst ping_idle_ping.py:24: start network... 12:08:22.937652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:23.388814 run create_hlr_db(pid=19634): Launched 12:08:23.499813 bus /gobi_6: Setting Powered False 12:08:24.559694 run create_hlr_db(pid=19634): Terminated: ok {rc=0} 12:08:24.989679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19636): Launched 12:08:25.304375 run osmo-hlr_10.42.42.2(pid=19637): Launched 12:08:25.423628 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:25.964618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19639): Launched 12:08:26.281524 run osmo-stp_10.42.42.5(pid=19640): Launched 12:08:26.400742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:26.944685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19642): Launched 12:08:27.057875 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:27.305684 run patchelf(pid=19643): Launched 12:08:27.468921 run osmo-stp_10.42.42.5(pid=19640): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19640)] 12:08:27.593847 run osmo-stp_10.42.42.5(pid=19640): stdout: | (launched: 2022-12-14_12:08:26.223201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:27.720580 run osmo-stp_10.42.42.5(pid=19640): stderr: | [0;m[38;5;43m20221214120826416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120826416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120826416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120826416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120826417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120826417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120826417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:27.847339 run osmo-stp_10.42.42.5(pid=19640): stdout: | (launched: 2022-12-14_12:08:26.223201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:27.967358 run osmo-stp_10.42.42.5(pid=19640): stderr: | [0;m[38;5;43m20221214120826416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120826416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120826416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120826416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120826417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120826417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120826417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:28.110001 run patchelf(pid=19643): Terminating (SIGINT) 12:08:28.275413 run patchelf(pid=19643): Terminated: ok {rc=0} 12:08:28.394827 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19640): Process ended prematurely: osmo-stp_10.42.42.5(pid=19640) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19640)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:08:28.403709 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 12:08:28.430064 run osmo-hlr_10.42.42.2(pid=19637): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19637)] 12:08:28.477538 run osmo-hlr_10.42.42.2(pid=19637): stdout: | (launched: 2022-12-14_12:08:25.247067) 12:08:28.526271 run osmo-hlr_10.42.42.2(pid=19637): stderr: | [0;m[1;31m20221214120825444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120825444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120825444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120825444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120825444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120825444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120825458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120825466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120825466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120825466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:28.575822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19636): Terminating (SIGTERM) 12:08:28.615470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19639): Terminating (SIGTERM) 12:08:28.654876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19642): Terminating (SIGTERM) 12:08:28.694820 --- ParallelTerminationStrategy: PID 19636 died... 12:08:28.713978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19636): Terminated: ok {rc=0} 12:08:28.757439 --- ParallelTerminationStrategy: PID 19639 died... 12:08:28.775870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19639): Terminated: ok {rc=0} 12:08:28.819241 --- ParallelTerminationStrategy: PID 19642 died... 12:08:28.837796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19642): Terminated: ok {rc=0} 12:08:28.923214 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:08:30.234225 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:08:30.241295 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:08:30.275308 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:08:30.315050 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:08:30.403308 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:08:30.436541 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:08:30.475997 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:08:31.099527 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:08:31.169689 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:31.183934 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:08:31.270969 tst cs_paging_gprs_active.py: using LAC 40793 12:08:31.429598 tst cs_paging_gprs_active.py: using RAC 248 12:08:31.552820 tst cs_paging_gprs_active.py: using CellId 40793 12:08:31.709287 tst cs_paging_gprs_active.py: using BVCI 40794 12:08:31.823467 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:31.835460 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:31.847271 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:31.859139 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:31.871874 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:31.884832 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:31.897651 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:31.910164 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:31.922904 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:08:32.047266 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:08:32.185483 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:08:32.391718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:32.695188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19647): Launched 12:08:32.956589 run iperf3-srv_10.42.42.10(pid=19648): Launched 12:08:33.068715 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:08:33.268738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:33.570429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19649): Launched 12:08:33.831238 run iperf3-srv_10.42.42.10(pid=19650): Launched 12:08:33.943494 tst cs_paging_gprs_active.py:38: start network... 12:08:34.142950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:34.606910 run create_hlr_db(pid=19651): Launched 12:08:34.720692 bus /gobi_6: Setting Powered False 12:08:35.780826 run create_hlr_db(pid=19651): Terminated: ok {rc=0} 12:08:36.220628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19653): Launched 12:08:36.541200 run osmo-hlr_10.42.42.2(pid=19654): Launched 12:08:36.665875 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:37.217164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19656): Launched 12:08:37.536211 run osmo-stp_10.42.42.5(pid=19657): Launched 12:08:37.659109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:38.209504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19659): Launched 12:08:38.331609 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:38.604394 run patchelf(pid=19660): Launched 12:08:38.783679 run osmo-stp_10.42.42.5(pid=19657): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19657)] 12:08:38.919062 run osmo-stp_10.42.42.5(pid=19657): stdout: | (launched: 2022-12-14_12:08:37.477534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:39.056334 run osmo-stp_10.42.42.5(pid=19657): stderr: | [0;m[38;5;43m20221214120837669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120837669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120837670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120837670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120837670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120837671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120837671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:39.193546 run osmo-stp_10.42.42.5(pid=19657): stdout: | (launched: 2022-12-14_12:08:37.477534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:39.324784 run osmo-stp_10.42.42.5(pid=19657): stderr: | [0;m[38;5;43m20221214120837669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120837669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120837670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120837670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120837670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120837671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120837671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:39.479987 run patchelf(pid=19660): Terminating (SIGINT) 12:08:39.660169 run patchelf(pid=19660): Terminated: ok {rc=0} 12:08:39.790011 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19657): Process ended prematurely: osmo-stp_10.42.42.5(pid=19657) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19657)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:08:39.800250 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:08:39.828428 run osmo-hlr_10.42.42.2(pid=19654): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19654)] 12:08:39.877697 run osmo-hlr_10.42.42.2(pid=19654): stdout: | (launched: 2022-12-14_12:08:36.482582) 12:08:39.929076 run osmo-hlr_10.42.42.2(pid=19654): stderr: | [0;m[1;31m20221214120836680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120836680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120836680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120836680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120836680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120836681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120836714 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120836724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120836724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120836724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:39.981062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19647): Terminating (SIGTERM) 12:08:40.022597 run iperf3-srv_10.42.42.10(pid=19648): Terminating (SIGTERM) 12:08:40.064098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19649): Terminating (SIGTERM) 12:08:40.105986 run iperf3-srv_10.42.42.10(pid=19650): Terminating (SIGTERM) 12:08:40.147431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19653): Terminating (SIGTERM) 12:08:40.189075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19656): Terminating (SIGTERM) 12:08:40.230828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19659): Terminating (SIGTERM) 12:08:40.272589 --- ParallelTerminationStrategy: PID 19647 died... 12:08:40.292658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19647): Terminated: ok {rc=0} 12:08:40.338685 --- ParallelTerminationStrategy: PID 19648 died... 12:08:40.358317 run iperf3-srv_10.42.42.10(pid=19648): Terminated {rc=256} 12:08:40.404111 --- ParallelTerminationStrategy: PID 19649 died... 12:08:40.423731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19649): Terminated: ok {rc=0} 12:08:40.469723 --- ParallelTerminationStrategy: PID 19650 died... 12:08:40.489322 run iperf3-srv_10.42.42.10(pid=19650): Terminated {rc=256} 12:08:40.534924 --- ParallelTerminationStrategy: PID 19653 died... 12:08:40.554589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19653): Terminated: ok {rc=0} 12:08:40.600556 --- ParallelTerminationStrategy: PID 19656 died... 12:08:40.620356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19656): Terminated: ok {rc=0} 12:08:40.666716 --- ParallelTerminationStrategy: PID 19659 died... 12:08:40.686520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19659): Terminated: ok {rc=0} 12:08:40.774174 bus /gobi_0: Setting Powered False 12:08:41.872472 bus /gobi_0: Setting Powered False 12:08:42.986869 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:08:44.134893 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:44.147184 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:08:44.219322 tst iperf3.py: using LAC 40794 12:08:44.346506 tst iperf3.py: using RAC 249 12:08:44.471392 tst iperf3.py: using CellId 40794 12:08:44.599764 tst iperf3.py: using BVCI 40795 12:08:44.718737 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:44.730222 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:44.741331 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:44.752463 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:44.763518 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:44.774764 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:44.786003 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:44.797088 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:44.808300 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:08:44.923980 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:08:45.122757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:45.421463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19661): Launched 12:08:45.681987 run iperf3-srv_10.42.42.10(pid=19662): Launched 12:08:45.793341 tst iperf3.py:8: start network... 12:08:45.995273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:46.467642 run create_hlr_db(pid=19663): Launched 12:08:46.622551 bus /gobi_6: Setting Powered False 12:08:47.681488 run create_hlr_db(pid=19663): Terminated: ok {rc=0} 12:08:48.118396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19665): Launched 12:08:48.439109 run osmo-hlr_10.42.42.2(pid=19666): Launched 12:08:48.562879 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:49.120438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19668): Launched 12:08:49.439415 run osmo-stp_10.42.42.5(pid=19669): Launched 12:08:49.562149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:50.112658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19671): Launched 12:08:50.234597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:50.504138 run patchelf(pid=19672): Launched 12:08:50.682531 run osmo-stp_10.42.42.5(pid=19669): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19669)] 12:08:50.818403 run osmo-stp_10.42.42.5(pid=19669): stdout: | (launched: 2022-12-14_12:08:49.380701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:50.955668 run osmo-stp_10.42.42.5(pid=19669): stderr: | [0;m[38;5;43m20221214120849571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120849571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120849571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120849571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120849572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120849572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120849572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:51.092786 run osmo-stp_10.42.42.5(pid=19669): stdout: | (launched: 2022-12-14_12:08:49.380701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:51.223440 run osmo-stp_10.42.42.5(pid=19669): stderr: | [0;m[38;5;43m20221214120849571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120849571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120849571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120849571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120849572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120849572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120849572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:51.379091 run patchelf(pid=19672): Terminating (SIGINT) 12:08:51.558557 run patchelf(pid=19672): Terminated: ok {rc=0} 12:08:51.688577 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19669): Process ended prematurely: osmo-stp_10.42.42.5(pid=19669) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19669)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 12:08:51.699020 tst iperf3.py:8: Test FAILED (7.6 sec) 12:08:51.727354 run osmo-hlr_10.42.42.2(pid=19666): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19666)] 12:08:51.777224 run osmo-hlr_10.42.42.2(pid=19666): stdout: | (launched: 2022-12-14_12:08:48.380152) 12:08:51.828660 run osmo-hlr_10.42.42.2(pid=19666): stderr: | [0;m[1;31m20221214120848580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120848580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120848580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120848580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120848580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120848580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120848593 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120848601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120848601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120848601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:51.880489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19661): Terminating (SIGTERM) 12:08:51.922188 run iperf3-srv_10.42.42.10(pid=19662): Terminating (SIGTERM) 12:08:51.963971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19665): Terminating (SIGTERM) 12:08:52.005819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19668): Terminating (SIGTERM) 12:08:52.047677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19671): Terminating (SIGTERM) 12:08:52.089801 --- ParallelTerminationStrategy: PID 19661 died... 12:08:52.109881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19661): Terminated: ok {rc=0} 12:08:52.155840 --- ParallelTerminationStrategy: PID 19662 died... 12:08:52.175483 run iperf3-srv_10.42.42.10(pid=19662): Terminated {rc=256} 12:08:52.221688 --- ParallelTerminationStrategy: PID 19665 died... 12:08:52.241314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19665): Terminated: ok {rc=0} 12:08:52.287476 --- ParallelTerminationStrategy: PID 19668 died... 12:08:52.307169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19668): Terminated: ok {rc=0} 12:08:52.353258 --- ParallelTerminationStrategy: PID 19671 died... 12:08:52.372592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19671): Terminated: ok {rc=0} 12:08:52.460307 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:08:53.612759 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:53.625148 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:08:53.700457 tst iperf3m4.py: using LAC 40795 12:08:53.824767 tst iperf3m4.py: using RAC 250 12:08:53.948710 tst iperf3m4.py: using CellId 40795 12:08:54.072713 tst iperf3m4.py: using BVCI 40796 12:08:54.188696 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:54.200203 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:54.211386 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:54.222666 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:54.233723 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:54.244863 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:54.256109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:54.267248 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:08:54.278599 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:08:54.395500 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:08:54.518791 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:08:54.633707 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:08:54.749787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:08:54.950021 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:55.249143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19673): Launched 12:08:55.510036 run iperf3-srv_10.42.42.10(pid=19674): Launched 12:08:55.623506 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:08:55.822162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:56.120742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19675): Launched 12:08:56.381177 run iperf3-srv_10.42.42.10(pid=19676): Launched 12:08:56.492699 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:08:56.691788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:56.991655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19677): Launched 12:08:57.250826 run iperf3-srv_10.42.42.10(pid=19678): Launched 12:08:57.363705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:08:57.562204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:57.860939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19679): Launched 12:08:58.121513 run iperf3-srv_10.42.42.10(pid=19680): Launched 12:08:58.232922 tst iperf3m4.py:8: start network... 12:08:58.431058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:58.892782 run create_hlr_db(pid=19681): Launched 12:08:59.007233 bus /gobi_6: Setting Powered False 12:09:00.066395 run create_hlr_db(pid=19681): Terminated: ok {rc=0} 12:09:00.483381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19683): Launched 12:09:00.781947 run osmo-hlr_10.42.42.2(pid=19684): Launched 12:09:00.971018 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:01.689117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19686): Launched 12:09:02.103355 run osmo-stp_10.42.42.5(pid=19719): Launched 12:09:02.360485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:03.067923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19759): Launched 12:09:03.269088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:03.603520 run patchelf(pid=19839): Launched 12:09:03.855065 run osmo-stp_10.42.42.5(pid=19719): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19719)] 12:09:04.036451 run osmo-stp_10.42.42.5(pid=19719): stdout: | (launched: 2022-12-14_12:09:02.027688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:04.205186 run osmo-stp_10.42.42.5(pid=19719): stderr: | [0;m[38;5;43m20221214120902346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120902346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120902346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120902347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120902347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120902347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120902347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:04.378714 run osmo-stp_10.42.42.5(pid=19719): stdout: | (launched: 2022-12-14_12:09:02.027688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:04.532167 run osmo-stp_10.42.42.5(pid=19719): stderr: | [0;m[38;5;43m20221214120902346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120902346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120902346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120902347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120902347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120902347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120902347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:04.706046 run patchelf(pid=19839): Terminating (SIGINT) 12:09:04.899617 run patchelf(pid=19839): Terminated: ok {rc=0} 12:09:05.035611 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19719): Process ended prematurely: osmo-stp_10.42.42.5(pid=19719) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19719)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:09:05.046773 tst iperf3m4.py:8: Test FAILED (11.5 sec) 12:09:05.077040 run osmo-hlr_10.42.42.2(pid=19684): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19684)] 12:09:05.129530 run osmo-hlr_10.42.42.2(pid=19684): stdout: | (launched: 2022-12-14_12:09:00.726456) 12:09:05.184614 run osmo-hlr_10.42.42.2(pid=19684): stderr: | [0;m[1;31m20221214120900985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120900985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120900985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120900985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120900986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120900986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120901005 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120901021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120901021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120901021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:05.240090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19673): Terminating (SIGTERM) 12:09:05.284360 run iperf3-srv_10.42.42.10(pid=19674): Terminating (SIGTERM) 12:09:05.332745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19675): Terminating (SIGTERM) 12:09:05.379057 run iperf3-srv_10.42.42.10(pid=19676): Terminating (SIGTERM) 12:09:05.426176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19677): Terminating (SIGTERM) 12:09:05.471216 run iperf3-srv_10.42.42.10(pid=19678): Terminating (SIGTERM) 12:09:05.518739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19679): Terminating (SIGTERM) 12:09:05.565497 run iperf3-srv_10.42.42.10(pid=19680): Terminating (SIGTERM) 12:09:05.613063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19683): Terminating (SIGTERM) 12:09:05.659999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19686): Terminating (SIGTERM) 12:09:05.706772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19759): Terminating (SIGTERM) 12:09:05.752720 --- ParallelTerminationStrategy: PID 19673 died... 12:09:05.775339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19673): Terminated: ok {rc=0} 12:09:05.824356 --- ParallelTerminationStrategy: PID 19674 died... 12:09:05.845458 run iperf3-srv_10.42.42.10(pid=19674): Terminated {rc=256} 12:09:05.893712 --- ParallelTerminationStrategy: PID 19675 died... 12:09:05.914841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19675): Terminated: ok {rc=0} 12:09:05.964405 --- ParallelTerminationStrategy: PID 19676 died... 12:09:05.985588 run iperf3-srv_10.42.42.10(pid=19676): Terminated {rc=256} 12:09:06.037726 --- ParallelTerminationStrategy: PID 19677 died... 12:09:06.058364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19677): Terminated: ok {rc=0} 12:09:06.106628 --- ParallelTerminationStrategy: PID 19678 died... 12:09:06.127732 run iperf3-srv_10.42.42.10(pid=19678): Terminated {rc=256} 12:09:06.176700 --- ParallelTerminationStrategy: PID 19679 died... 12:09:06.197944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19679): Terminated: ok {rc=0} 12:09:06.246163 --- ParallelTerminationStrategy: PID 19680 died... 12:09:06.267127 run iperf3-srv_10.42.42.10(pid=19680): Terminated {rc=256} 12:09:06.314999 --- ParallelTerminationStrategy: PID 19683 died... 12:09:06.336044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19683): Terminated: ok {rc=0} 12:09:06.385301 --- ParallelTerminationStrategy: PID 19686 died... 12:09:06.406198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19686): Terminated: ok {rc=0} 12:09:06.454070 --- ParallelTerminationStrategy: PID 19759 died... 12:09:06.475230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19759): Terminated: ok {rc=0} 12:09:06.568472 bus /gobi_4: Setting Powered False 12:09:07.673925 bus /gobi_4: Setting Powered False 12:09:08.792228 bus /gobi_1: Setting Powered False 12:09:09.895311 bus /gobi_1: Setting Powered False 12:09:11.020518 bus /gobi_0: Setting Powered False 12:09:12.124467 bus /gobi_0: Setting Powered False 12:09:13.247867 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:09:14.354257 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:14.367003 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:09:14.441872 tst ping.py: using LAC 40796 12:09:14.584244 tst ping.py: using RAC 251 12:09:14.706964 tst ping.py: using CellId 40796 12:09:14.829767 tst ping.py: using BVCI 40797 12:09:14.943865 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:14.957737 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:14.969735 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:14.981647 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:14.994665 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:15.007570 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:15.021082 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:15.035817 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:09:15.155414 tst ping.py:19: start network... 12:09:15.362258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:15.860758 run create_hlr_db(pid=19970): Launched 12:09:16.069927 bus /gobi_6: Setting Powered False 12:09:17.168698 run create_hlr_db(pid=19970): Terminated: ok {rc=0} 12:09:17.732821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19972): Launched 12:09:18.060734 run osmo-hlr_10.42.42.2(pid=19973): Launched 12:09:18.294961 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:19.025749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19975): Launched 12:09:19.345992 run osmo-stp_10.42.42.5(pid=19976): Launched 12:09:19.577591 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:20.273180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19978): Launched 12:09:20.403250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:20.665860 run patchelf(pid=19979): Launched 12:09:20.859764 run osmo-stp_10.42.42.5(pid=19976): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19976)] 12:09:20.999556 run osmo-stp_10.42.42.5(pid=19976): stdout: | (launched: 2022-12-14_12:09:19.288375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:21.140237 run osmo-stp_10.42.42.5(pid=19976): stderr: | [0;m[38;5;43m20221214120919626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120919626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120919626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120919626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120919627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120919627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120919627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:21.282003 run osmo-stp_10.42.42.5(pid=19976): stdout: | (launched: 2022-12-14_12:09:19.288375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:21.417677 run osmo-stp_10.42.42.5(pid=19976): stderr: | [0;m[38;5;43m20221214120919626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120919626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120919626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120919626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120919627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120919627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120919627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:21.577691 run patchelf(pid=19979): Terminating (SIGINT) 12:09:21.762720 run patchelf(pid=19979): Terminated: ok {rc=0} 12:09:21.896305 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19976): Process ended prematurely: osmo-stp_10.42.42.5(pid=19976) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19976)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 12:09:21.907221 tst ping.py:22: Test FAILED (7.5 sec) 12:09:21.937294 run osmo-hlr_10.42.42.2(pid=19973): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19973)] 12:09:21.991776 run osmo-hlr_10.42.42.2(pid=19973): stdout: | (launched: 2022-12-14_12:09:18.003663) 12:09:22.046323 run osmo-hlr_10.42.42.2(pid=19973): stderr: | [0;m[1;31m20221214120918349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120918349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120918349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120918349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120918349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120918349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120918367 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120918384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120918384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120918384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:22.101489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19972): Terminating (SIGTERM) 12:09:22.145590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19975): Terminating (SIGTERM) 12:09:22.192436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19978): Terminating (SIGTERM) 12:09:22.237551 --- ParallelTerminationStrategy: PID 19972 died... 12:09:22.258972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19972): Terminated: ok {rc=0} 12:09:22.309227 --- ParallelTerminationStrategy: PID 19975 died... 12:09:22.329989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19975): Terminated: ok {rc=0} 12:09:22.378932 --- ParallelTerminationStrategy: PID 19978 died... 12:09:22.399658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19978): Terminated: ok {rc=0} 12:09:22.491720 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:09:23.588492 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:23.601920 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:09:23.678689 tst ping_idle_ping.py: using LAC 40797 12:09:23.806487 tst ping_idle_ping.py: using RAC 252 12:09:23.933659 tst ping_idle_ping.py: using CellId 40797 12:09:24.063020 tst ping_idle_ping.py: using BVCI 40798 12:09:24.184214 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:24.196889 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:24.209665 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:24.221900 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:24.234418 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:24.246848 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:24.259757 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:24.272426 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:09:24.396757 tst ping_idle_ping.py:24: start network... 12:09:24.619032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:25.129075 run create_hlr_db(pid=19980): Launched 12:09:25.243867 bus /gobi_6: Setting Powered False 12:09:26.304575 run create_hlr_db(pid=19980): Terminated: ok {rc=0} 12:09:26.723171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19982): Launched 12:09:27.023961 run osmo-hlr_10.42.42.2(pid=19983): Launched 12:09:27.139114 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:27.665875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19985): Launched 12:09:27.966367 run osmo-stp_10.42.42.5(pid=19986): Launched 12:09:28.083804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:28.601221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19988): Launched 12:09:28.725031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:28.996902 run patchelf(pid=19989): Launched 12:09:29.177468 run osmo-stp_10.42.42.5(pid=19986): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19986)] 12:09:29.313774 run osmo-stp_10.42.42.5(pid=19986): stdout: | (launched: 2022-12-14_12:09:27.910428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:29.451903 run osmo-stp_10.42.42.5(pid=19986): stderr: | [0;m[38;5;43m20221214120928079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120928079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120928079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120928080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120928082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120928082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120928082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:29.590251 run osmo-stp_10.42.42.5(pid=19986): stdout: | (launched: 2022-12-14_12:09:27.910428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:29.721956 run osmo-stp_10.42.42.5(pid=19986): stderr: | [0;m[38;5;43m20221214120928079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120928079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120928079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120928080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120928082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120928082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120928082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:29.877669 run patchelf(pid=19989): Terminating (SIGINT) 12:09:30.057815 run patchelf(pid=19989): Terminated: ok {rc=0} 12:09:30.187520 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19986): Process ended prematurely: osmo-stp_10.42.42.5(pid=19986) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19986)] [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:09:30.197293 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:09:30.225611 run osmo-hlr_10.42.42.2(pid=19983): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19983)] 12:09:30.276177 run osmo-hlr_10.42.42.2(pid=19983): stdout: | (launched: 2022-12-14_12:09:26.968442) 12:09:30.328267 run osmo-hlr_10.42.42.2(pid=19983): stderr: | [0;m[1;31m20221214120927142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120927142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120927142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120927142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120927142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120927142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120927154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120927162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120927163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120927163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:30.380883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19982): Terminating (SIGTERM) 12:09:30.423262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19985): Terminating (SIGTERM) 12:09:30.465630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19988): Terminating (SIGTERM) 12:09:30.508319 --- ParallelTerminationStrategy: PID 19982 died... 12:09:30.528854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19982): Terminated: ok {rc=0} 12:09:30.575816 --- ParallelTerminationStrategy: PID 19985 died... 12:09:30.595644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19985): Terminated: ok {rc=0} 12:09:30.642061 --- ParallelTerminationStrategy: PID 19988 died... 12:09:30.662284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19988): Terminated: ok {rc=0} 12:09:30.751175 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:09:32.053255 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:32.060647 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:09:32.096703 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 12:09:32.138486 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 12:09:32.228278 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:09:32.260426 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 12:09:32.299190 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 12:09:32.907973 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 12:09:32.958358 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:32.970029 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:09:33.020588 tst cs_paging_gprs_active.py: using LAC 40798 12:09:33.143439 tst cs_paging_gprs_active.py: using RAC 253 12:09:33.262132 tst cs_paging_gprs_active.py: using CellId 40798 12:09:33.382094 tst cs_paging_gprs_active.py: using BVCI 40799 12:09:33.494762 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:33.506271 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:33.517647 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:33.529065 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:33.540773 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:33.552532 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:33.564478 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:33.576185 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:33.588269 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:09:33.712394 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:09:33.831019 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:09:34.035117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:34.341749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19993): Launched 12:09:34.608911 run iperf3-srv_10.42.42.10(pid=19994): Launched 12:09:34.724253 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:09:34.928074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:35.235855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19995): Launched 12:09:35.503452 run iperf3-srv_10.42.42.10(pid=19996): Launched 12:09:35.617923 tst cs_paging_gprs_active.py:38: start network... 12:09:35.821075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:36.293518 run create_hlr_db(pid=19997): Launched 12:09:36.410226 bus /gobi_6: Setting Powered False 12:09:37.471062 run create_hlr_db(pid=19997): Terminated: ok {rc=0} 12:09:37.920856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19999): Launched 12:09:38.248167 run osmo-hlr_10.42.42.2(pid=20000): Launched 12:09:38.375039 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:38.941585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20002): Launched 12:09:39.268040 run osmo-stp_10.42.42.5(pid=20003): Launched 12:09:39.394242 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:39.956194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20005): Launched 12:09:40.082436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:40.358326 run patchelf(pid=20006): Launched 12:09:40.538889 run osmo-stp_10.42.42.5(pid=20003): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20003)] 12:09:40.676505 run osmo-stp_10.42.42.5(pid=20003): stdout: | (launched: 2022-12-14_12:09:39.207900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:40.815754 run osmo-stp_10.42.42.5(pid=20003): stderr: | [0;m[38;5;43m20221214120939403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120939403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120939403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120939404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120939404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120939404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120939404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:40.954976 run osmo-stp_10.42.42.5(pid=20003): stdout: | (launched: 2022-12-14_12:09:39.207900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:41.088101 run osmo-stp_10.42.42.5(pid=20003): stderr: | [0;m[38;5;43m20221214120939403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120939403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120939403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120939404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120939404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120939404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120939404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:41.246090 run patchelf(pid=20006): Terminating (SIGINT) 12:09:41.428122 run patchelf(pid=20006): Terminated: ok {rc=0} 12:09:41.559371 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20003): Process ended prematurely: osmo-stp_10.42.42.5(pid=20003) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20003)] [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 12:09:41.569651 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:09:41.598326 run osmo-hlr_10.42.42.2(pid=20000): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20000)] 12:09:41.648170 run osmo-hlr_10.42.42.2(pid=20000): stdout: | (launched: 2022-12-14_12:09:38.187896) 12:09:41.700103 run osmo-hlr_10.42.42.2(pid=20000): stderr: | [0;m[1;31m20221214120938388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120938388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120938388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120938388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120938388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120938389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120938399 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120938408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120938408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120938408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:41.752392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19993): Terminating (SIGTERM) 12:09:41.794076 run iperf3-srv_10.42.42.10(pid=19994): Terminating (SIGTERM) 12:09:41.836782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19995): Terminating (SIGTERM) 12:09:41.878492 run iperf3-srv_10.42.42.10(pid=19996): Terminating (SIGTERM) 12:09:41.920268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19999): Terminating (SIGTERM) 12:09:41.962023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20002): Terminating (SIGTERM) 12:09:42.003625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20005): Terminating (SIGTERM) 12:09:42.045576 --- ParallelTerminationStrategy: PID 19993 died... 12:09:42.065679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19993): Terminated: ok {rc=0} 12:09:42.112211 --- ParallelTerminationStrategy: PID 19994 died... 12:09:42.131725 run iperf3-srv_10.42.42.10(pid=19994): Terminated {rc=256} 12:09:42.177523 --- ParallelTerminationStrategy: PID 19995 died... 12:09:42.196901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19995): Terminated: ok {rc=0} 12:09:42.242610 --- ParallelTerminationStrategy: PID 19996 died... 12:09:42.262101 run iperf3-srv_10.42.42.10(pid=19996): Terminated {rc=256} 12:09:42.307650 --- ParallelTerminationStrategy: PID 19999 died... 12:09:42.327201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19999): Terminated: ok {rc=0} 12:09:42.372928 --- ParallelTerminationStrategy: PID 20002 died... 12:09:42.392397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20002): Terminated: ok {rc=0} 12:09:42.438333 --- ParallelTerminationStrategy: PID 20005 died... 12:09:42.457819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20005): Terminated: ok {rc=0} 12:09:42.545949 bus /gobi_0: Setting Powered False 12:09:43.644436 bus /gobi_0: Setting Powered False 12:09:44.761425 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 12:09:45.918585 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:45.931663 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:09:45.992675 tst iperf3.py: using LAC 40799 12:09:46.121943 tst iperf3.py: using RAC 254 12:09:46.277362 tst iperf3.py: using CellId 40799 12:09:46.401243 tst iperf3.py: using BVCI 40800 12:09:46.535583 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:46.552296 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:46.570165 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:46.584167 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:46.598899 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:46.614478 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:46.631791 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:46.647404 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:46.663924 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:09:46.821655 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:09:47.042218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:47.355581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20009): Launched 12:09:47.624823 run iperf3-srv_10.42.42.10(pid=20010): Launched 12:09:47.739321 tst iperf3.py:8: start network... 12:09:47.943321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:48.414573 run create_hlr_db(pid=20011): Launched 12:09:48.532314 bus /gobi_6: Setting Powered False 12:09:49.593134 run create_hlr_db(pid=20011): Terminated: ok {rc=0} 12:09:50.040115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20013): Launched 12:09:50.366582 run osmo-hlr_10.42.42.2(pid=20014): Launched 12:09:50.490368 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:51.029613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20016): Launched 12:09:51.334297 run osmo-stp_10.42.42.5(pid=20017): Launched 12:09:51.450240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:51.975442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20019): Launched 12:09:52.092559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:52.350629 run patchelf(pid=20020): Launched 12:09:52.520175 run osmo-stp_10.42.42.5(pid=20017): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20017)] 12:09:52.650285 run osmo-stp_10.42.42.5(pid=20017): stdout: | (launched: 2022-12-14_12:09:51.277785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:52.781192 run osmo-stp_10.42.42.5(pid=20017): stderr: | [0;m[38;5;43m20221214120951452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120951452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120951452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120951453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120951453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120951453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120951453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:52.912710 run osmo-stp_10.42.42.5(pid=20017): stdout: | (launched: 2022-12-14_12:09:51.277785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:53.037644 run osmo-stp_10.42.42.5(pid=20017): stderr: | [0;m[38;5;43m20221214120951452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214120951452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214120951452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214120951453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214120951453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214120951453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214120951453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:53.185915 run patchelf(pid=20020): Terminating (SIGINT) 12:09:53.358585 run patchelf(pid=20020): Terminated: ok {rc=0} 12:09:53.482745 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20017): Process ended prematurely: osmo-stp_10.42.42.5(pid=20017) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20017)] [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 12:09:53.492306 tst iperf3.py:8: Test FAILED (7.6 sec) 12:09:53.519480 run osmo-hlr_10.42.42.2(pid=20014): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20014)] 12:09:53.567701 run osmo-hlr_10.42.42.2(pid=20014): stdout: | (launched: 2022-12-14_12:09:50.305703) 12:09:53.617573 run osmo-hlr_10.42.42.2(pid=20014): stderr: | [0;m[1;31m20221214120950507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214120950507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214120950507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214120950507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214120950507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214120950507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214120950519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214120950527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214120950527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214120950527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:53.667873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20009): Terminating (SIGTERM) 12:09:53.708622 run iperf3-srv_10.42.42.10(pid=20010): Terminating (SIGTERM) 12:09:53.748910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20013): Terminating (SIGTERM) 12:09:53.789338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20016): Terminating (SIGTERM) 12:09:53.829992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20019): Terminating (SIGTERM) 12:09:53.871104 --- ParallelTerminationStrategy: PID 20009 died... 12:09:53.890829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20009): Terminated: ok {rc=0} 12:09:53.935343 --- ParallelTerminationStrategy: PID 20010 died... 12:09:53.954322 run iperf3-srv_10.42.42.10(pid=20010): Terminated {rc=256} 12:09:53.998323 --- ParallelTerminationStrategy: PID 20013 died... 12:09:54.017370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20013): Terminated: ok {rc=0} 12:09:54.061904 --- ParallelTerminationStrategy: PID 20016 died... 12:09:54.080760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20016): Terminated: ok {rc=0} 12:09:54.124794 --- ParallelTerminationStrategy: PID 20019 died... 12:09:54.143730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20019): Terminated: ok {rc=0} 12:09:54.228448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 12:09:55.371896 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:55.383762 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:09:55.437456 tst iperf3m4.py: using LAC 40800 12:09:55.557377 tst iperf3m4.py: using RAC 255 12:09:55.676090 tst iperf3m4.py: using CellId 40800 12:09:55.797265 tst iperf3m4.py: using BVCI 40801 12:09:55.907452 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:55.918982 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:55.930264 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:55.941681 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:55.953372 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:55.964854 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:55.976511 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:55.988064 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:09:55.999849 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:09:56.116895 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:09:56.238992 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:09:56.357430 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:09:56.478180 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:09:56.682344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:56.988939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20021): Launched 12:09:57.254339 run iperf3-srv_10.42.42.10(pid=20022): Launched 12:09:57.370302 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:09:57.572355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:57.877816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20023): Launched 12:09:58.142480 run iperf3-srv_10.42.42.10(pid=20024): Launched 12:09:58.258344 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:09:58.460690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:58.766541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20025): Launched 12:09:59.031639 run iperf3-srv_10.42.42.10(pid=20026): Launched 12:09:59.145512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:09:59.348551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:59.654504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20027): Launched 12:09:59.919351 run iperf3-srv_10.42.42.10(pid=20028): Launched 12:10:00.034606 tst iperf3m4.py:8: start network... 12:10:00.237297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:00.707452 run create_hlr_db(pid=20029): Launched 12:10:00.822959 bus /gobi_6: Setting Powered False 12:10:01.882532 run create_hlr_db(pid=20029): Terminated: ok {rc=0} 12:10:02.333491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20034): Launched 12:10:02.641327 run osmo-hlr_10.42.42.2(pid=20035): Launched 12:10:02.759135 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:03.289186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20037): Launched 12:10:03.593990 run osmo-stp_10.42.42.5(pid=20038): Launched 12:10:03.711296 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:04.235400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20040): Launched 12:10:04.354175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:04.611791 run patchelf(pid=20041): Launched 12:10:04.783210 run osmo-stp_10.42.42.5(pid=20038): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20038)] 12:10:04.912642 run osmo-stp_10.42.42.5(pid=20038): stdout: | (launched: 2022-12-14_12:10:03.537368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:05.043443 run osmo-stp_10.42.42.5(pid=20038): stderr: | [0;m[38;5;43m20221214121003709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121003709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121003709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121003710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121003710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121003710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121003710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:05.174458 run osmo-stp_10.42.42.5(pid=20038): stdout: | (launched: 2022-12-14_12:10:03.537368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:05.299761 run osmo-stp_10.42.42.5(pid=20038): stderr: | [0;m[38;5;43m20221214121003709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121003709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121003709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121003710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121003710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121003710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121003710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:05.448332 run patchelf(pid=20041): Terminating (SIGINT) 12:10:05.619640 run patchelf(pid=20041): Terminated: ok {rc=0} 12:10:05.742921 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20038): Process ended prematurely: osmo-stp_10.42.42.5(pid=20038) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20038)] [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 12:10:05.752473 tst iperf3m4.py:8: Test FAILED (10.4 sec) 12:10:05.779977 run osmo-hlr_10.42.42.2(pid=20035): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20035)] 12:10:05.828914 run osmo-hlr_10.42.42.2(pid=20035): stdout: | (launched: 2022-12-14_12:10:02.584395) 12:10:05.879128 run osmo-hlr_10.42.42.2(pid=20035): stderr: | [0;m[1;31m20221214121002761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121002761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121002761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121002761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121002761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121002761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121002773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121002781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121002781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121002781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:05.929582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20021): Terminating (SIGTERM) 12:10:05.970459 run iperf3-srv_10.42.42.10(pid=20022): Terminating (SIGTERM) 12:10:06.010750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20023): Terminating (SIGTERM) 12:10:06.051318 run iperf3-srv_10.42.42.10(pid=20024): Terminating (SIGTERM) 12:10:06.091572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20025): Terminating (SIGTERM) 12:10:06.132295 run iperf3-srv_10.42.42.10(pid=20026): Terminating (SIGTERM) 12:10:06.173403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20027): Terminating (SIGTERM) 12:10:06.214370 run iperf3-srv_10.42.42.10(pid=20028): Terminating (SIGTERM) 12:10:06.254534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20034): Terminating (SIGTERM) 12:10:06.294867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20037): Terminating (SIGTERM) 12:10:06.335277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20040): Terminating (SIGTERM) 12:10:06.376363 --- ParallelTerminationStrategy: PID 20021 died... 12:10:06.396209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20021): Terminated: ok {rc=0} 12:10:06.440473 --- ParallelTerminationStrategy: PID 20022 died... 12:10:06.459443 run iperf3-srv_10.42.42.10(pid=20022): Terminated {rc=256} 12:10:06.503502 --- ParallelTerminationStrategy: PID 20023 died... 12:10:06.522685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20023): Terminated: ok {rc=0} 12:10:06.566728 --- ParallelTerminationStrategy: PID 20024 died... 12:10:06.585555 run iperf3-srv_10.42.42.10(pid=20024): Terminated {rc=256} 12:10:06.629612 --- ParallelTerminationStrategy: PID 20025 died... 12:10:06.648805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20025): Terminated: ok {rc=0} 12:10:06.692922 --- ParallelTerminationStrategy: PID 20026 died... 12:10:06.711975 run iperf3-srv_10.42.42.10(pid=20026): Terminated {rc=256} 12:10:06.756013 --- ParallelTerminationStrategy: PID 20027 died... 12:10:06.775160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20027): Terminated: ok {rc=0} 12:10:06.819231 --- ParallelTerminationStrategy: PID 20028 died... 12:10:06.838347 run iperf3-srv_10.42.42.10(pid=20028): Terminated {rc=256} 12:10:06.882496 --- ParallelTerminationStrategy: PID 20034 died... 12:10:06.901670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20034): Terminated: ok {rc=0} 12:10:06.945944 --- ParallelTerminationStrategy: PID 20037 died... 12:10:06.965078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20037): Terminated: ok {rc=0} 12:10:07.009146 --- ParallelTerminationStrategy: PID 20040 died... 12:10:07.028050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20040): Terminated: ok {rc=0} 12:10:07.114875 bus /gobi_4: Setting Powered False 12:10:08.214078 bus /gobi_4: Setting Powered False 12:10:09.329417 bus /gobi_1: Setting Powered False 12:10:10.428718 bus /gobi_1: Setting Powered False 12:10:11.545207 bus /gobi_0: Setting Powered False 12:10:12.644460 bus /gobi_0: Setting Powered False 12:10:13.760091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 12:10:14.863715 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:14.875658 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:10:14.928273 tst ping.py: using LAC 40801 12:10:15.044267 tst ping.py: using RAC 1 12:10:15.160400 tst ping.py: using CellId 40801 12:10:15.278232 tst ping.py: using BVCI 40802 12:10:15.387873 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:15.399210 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:15.410654 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:15.421833 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:15.433357 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:15.444702 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:15.456200 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:15.467652 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:10:15.583072 tst ping.py:19: start network... 12:10:15.781941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:16.247539 run create_hlr_db(pid=20042): Launched 12:10:16.411644 bus /gobi_6: Setting Powered False 12:10:17.475298 run create_hlr_db(pid=20042): Terminated: ok {rc=0} 12:10:17.921181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20044): Launched 12:10:18.219509 run osmo-hlr_10.42.42.2(pid=20045): Launched 12:10:18.335558 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:18.863619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20047): Launched 12:10:19.163011 run osmo-stp_10.42.42.5(pid=20048): Launched 12:10:19.278169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:19.808514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20050): Launched 12:10:19.922880 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:20.175650 run patchelf(pid=20051): Launched 12:10:20.342874 run osmo-stp_10.42.42.5(pid=20048): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20048)] 12:10:20.469445 run osmo-stp_10.42.42.5(pid=20048): stdout: | (launched: 2022-12-14_12:10:19.106957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:20.598030 run osmo-stp_10.42.42.5(pid=20048): stderr: | [0;m[38;5;43m20221214121019280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121019280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121019280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121019281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121019281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121019282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121019282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:20.727003 run osmo-stp_10.42.42.5(pid=20048): stdout: | (launched: 2022-12-14_12:10:19.106957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:20.849169 run osmo-stp_10.42.42.5(pid=20048): stderr: | [0;m[38;5;43m20221214121019280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121019280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121019280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121019281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121019281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121019282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121019282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:20.993627 run patchelf(pid=20051): Terminating (SIGINT) 12:10:21.161231 run patchelf(pid=20051): Terminated: ok {rc=0} 12:10:21.281888 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20048): Process ended prematurely: osmo-stp_10.42.42.5(pid=20048) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20048)] [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 12:10:21.290805 tst ping.py:22: Test FAILED (6.4 sec) 12:10:21.317405 run osmo-hlr_10.42.42.2(pid=20045): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20045)] 12:10:21.365452 run osmo-hlr_10.42.42.2(pid=20045): stdout: | (launched: 2022-12-14_12:10:18.164109) 12:10:21.414813 run osmo-hlr_10.42.42.2(pid=20045): stderr: | [0;m[1;31m20221214121018336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121018336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121018336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121018336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121018336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121018336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121018355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121018364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121018364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121018365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:21.464823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20044): Terminating (SIGTERM) 12:10:21.504912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20047): Terminating (SIGTERM) 12:10:21.545060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20050): Terminating (SIGTERM) 12:10:21.585396 --- ParallelTerminationStrategy: PID 20044 died... 12:10:21.604737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20044): Terminated: ok {rc=0} 12:10:21.648816 --- ParallelTerminationStrategy: PID 20047 died... 12:10:21.668151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20047): Terminated: ok {rc=0} 12:10:21.712139 --- ParallelTerminationStrategy: PID 20050 died... 12:10:21.731116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20050): Terminated: ok {rc=0} 12:10:21.817730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 12:10:22.906195 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:22.918714 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:10:22.972651 tst ping_idle_ping.py: using LAC 40802 12:10:23.100674 tst ping_idle_ping.py: using RAC 2 12:10:23.226689 tst ping_idle_ping.py: using CellId 40802 12:10:23.354396 tst ping_idle_ping.py: using BVCI 40803 12:10:23.472028 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:23.484243 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:23.496137 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:23.508048 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:23.520387 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:23.532787 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:23.545769 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:10:23.557762 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:10:23.674729 tst ping_idle_ping.py:24: start network... 12:10:23.875445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:24.340810 run create_hlr_db(pid=20052): Launched 12:10:24.456404 bus /gobi_6: Setting Powered False 12:10:25.517308 run create_hlr_db(pid=20052): Terminated: ok {rc=0} 12:10:25.958164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20054): Launched 12:10:26.278071 run osmo-hlr_10.42.42.2(pid=20055): Launched 12:10:26.399253 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:26.955598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20057): Launched 12:10:27.277205 run osmo-stp_10.42.42.5(pid=20058): Launched 12:10:27.400316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:27.954222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20060): Launched 12:10:28.076111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:28.346810 run patchelf(pid=20061): Launched 12:10:28.526245 run osmo-stp_10.42.42.5(pid=20058): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20058)] 12:10:28.661677 run osmo-stp_10.42.42.5(pid=20058): stdout: | (launched: 2022-12-14_12:10:27.218107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:28.799673 run osmo-stp_10.42.42.5(pid=20058): stderr: | [0;m[38;5;43m20221214121027413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121027413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121027413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121027414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121027414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121027414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121027414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:28.937219 run osmo-stp_10.42.42.5(pid=20058): stdout: | (launched: 2022-12-14_12:10:27.218107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:29.067773 run osmo-stp_10.42.42.5(pid=20058): stderr: | [0;m[38;5;43m20221214121027413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121027413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121027413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121027414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121027414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121027414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121027414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:29.222939 run patchelf(pid=20061): Terminating (SIGINT) 12:10:29.402134 run patchelf(pid=20061): Terminated: ok {rc=0} 12:10:29.531306 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20058): Process ended prematurely: osmo-stp_10.42.42.5(pid=20058) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20058)] [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 12:10:29.541149 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:10:29.569600 run osmo-hlr_10.42.42.2(pid=20055): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20055)] 12:10:29.619543 run osmo-hlr_10.42.42.2(pid=20055): stdout: | (launched: 2022-12-14_12:10:26.218628) 12:10:29.671299 run osmo-hlr_10.42.42.2(pid=20055): stderr: | [0;m[1;31m20221214121026417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121026418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121026418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121026418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121026418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121026418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121026430 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121026438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121026438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121026438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:29.723516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20054): Terminating (SIGTERM) 12:10:29.765523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20057): Terminating (SIGTERM) 12:10:29.807641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20060): Terminating (SIGTERM) 12:10:29.849974 --- ParallelTerminationStrategy: PID 20054 died... 12:10:29.870253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20054): Terminated: ok {rc=0} 12:10:29.916813 --- ParallelTerminationStrategy: PID 20057 died... 12:10:29.937051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20057): Terminated: ok {rc=0} 12:10:29.983169 --- ParallelTerminationStrategy: PID 20060 died... 12:10:30.002779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20060): Terminated: ok {rc=0} 12:10:30.091181 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:10:31.406181 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:31.415246 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:10:31.459515 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:10:31.504198 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:10:31.572908 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:10:31.615761 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:10:31.660658 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:10:32.205468 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:10:32.211407 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:32.223223 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:10:32.294294 tst switch_tch_pdch.py: using LAC 40803 12:10:32.409355 tst switch_tch_pdch.py: using RAC 3 12:10:32.523540 tst switch_tch_pdch.py: using CellId 40803 12:10:32.639004 tst switch_tch_pdch.py: using BVCI 40804 12:10:32.746342 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:32.757552 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:32.768494 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:32.779525 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:32.790797 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:32.802102 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:32.813484 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:32.824795 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:10:32.945480 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:10:33.066039 tst switch_tch_pdch.py:51: start network... 12:10:33.281056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:33.774909 run create_hlr_db(pid=20065): Launched 12:10:33.906038 bus /gobi_6: Setting Powered False 12:10:34.968480 run create_hlr_db(pid=20065): Terminated: ok {rc=0} 12:10:35.395751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20067): Launched 12:10:35.695236 run osmo-hlr_10.42.42.2(pid=20068): Launched 12:10:35.807798 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:36.318580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20070): Launched 12:10:36.615463 run osmo-stp_10.42.42.5(pid=20071): Launched 12:10:36.728929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:37.242583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20073): Launched 12:10:37.356066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:37.608115 run patchelf(pid=20074): Launched 12:10:37.773661 run osmo-stp_10.42.42.5(pid=20071): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20071)] 12:10:37.900706 run osmo-stp_10.42.42.5(pid=20071): stdout: | (launched: 2022-12-14_12:10:36.560420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:38.029334 run osmo-stp_10.42.42.5(pid=20071): stderr: | [0;m[38;5;43m20221214121036730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121036730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121036730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121036730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121036733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121036733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121036733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:38.158164 run osmo-stp_10.42.42.5(pid=20071): stdout: | (launched: 2022-12-14_12:10:36.560420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:38.280352 run osmo-stp_10.42.42.5(pid=20071): stderr: | [0;m[38;5;43m20221214121036730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121036730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121036730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121036730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121036733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121036733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121036733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:38.424825 run patchelf(pid=20074): Terminating (SIGINT) 12:10:38.592224 run patchelf(pid=20074): Terminated: ok {rc=0} 12:10:38.712447 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20071): Process ended prematurely: osmo-stp_10.42.42.5(pid=20071) [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20071)] [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:10:38.721511 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 12:10:38.747929 run osmo-hlr_10.42.42.2(pid=20068): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20068)] 12:10:38.796130 run osmo-hlr_10.42.42.2(pid=20068): stdout: | (launched: 2022-12-14_12:10:35.639360) 12:10:38.845911 run osmo-hlr_10.42.42.2(pid=20068): stderr: | [0;m[1;31m20221214121035817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121035817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121035817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121035817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121035817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121035817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121035868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121035877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121035878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121035878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:38.896036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20067): Terminating (SIGTERM) 12:10:38.936524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20070): Terminating (SIGTERM) 12:10:38.977066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20073): Terminating (SIGTERM) 12:10:39.017772 --- ParallelTerminationStrategy: PID 20067 died... 12:10:39.037385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20067): Terminated: ok {rc=0} 12:10:39.081518 --- ParallelTerminationStrategy: PID 20070 died... 12:10:39.100359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20070): Terminated: ok {rc=0} 12:10:39.144599 --- ParallelTerminationStrategy: PID 20073 died... 12:10:39.163584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20073): Terminated: ok {rc=0} 12:10:39.247894 bus /gobi_0: Setting Powered False 12:10:40.344779 bus /gobi_0: Setting Powered False 12:10:41.460620 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:10:42.712244 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:42.718199 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:10:42.750103 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:10:42.785130 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:10:42.839241 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:10:42.871584 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:10:42.906635 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:10:43.464056 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:10:43.470422 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:43.482127 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:10:43.553368 tst switch_tch_pdch.py: using LAC 40804 12:10:43.678994 tst switch_tch_pdch.py: using RAC 4 12:10:43.803847 tst switch_tch_pdch.py: using CellId 40804 12:10:43.928862 tst switch_tch_pdch.py: using BVCI 40805 12:10:44.043697 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:44.055112 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:44.066307 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:44.077568 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:44.088641 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:44.099912 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:44.111625 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:44.123002 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:10:44.239620 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:10:44.356033 tst switch_tch_pdch.py:51: start network... 12:10:44.571743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:45.038408 run create_hlr_db(pid=20078): Launched 12:10:45.167338 bus /gobi_6: Setting Powered False 12:10:46.226988 run create_hlr_db(pid=20078): Terminated: ok {rc=0} 12:10:46.629737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20080): Launched 12:10:46.948174 run osmo-hlr_10.42.42.2(pid=20081): Launched 12:10:47.186050 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:47.718848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20083): Launched 12:10:48.037969 run osmo-stp_10.42.42.5(pid=20084): Launched 12:10:48.159627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:48.682426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20086): Launched 12:10:48.804499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:49.074651 run patchelf(pid=20087): Launched 12:10:49.251410 run osmo-stp_10.42.42.5(pid=20084): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20084)] 12:10:49.386849 run osmo-stp_10.42.42.5(pid=20084): stdout: | (launched: 2022-12-14_12:10:47.979068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:49.523737 run osmo-stp_10.42.42.5(pid=20084): stderr: | [0;m[38;5;43m20221214121048172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121048172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121048172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121048173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121048176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121048176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121048177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:49.660801 run osmo-stp_10.42.42.5(pid=20084): stdout: | (launched: 2022-12-14_12:10:47.979068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:49.792276 run osmo-stp_10.42.42.5(pid=20084): stderr: | [0;m[38;5;43m20221214121048172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121048172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121048172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121048173 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121048176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121048176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121048177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:49.946931 run patchelf(pid=20087): Terminating (SIGINT) 12:10:50.125707 run patchelf(pid=20087): Terminated: ok {rc=0} 12:10:50.253648 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20084): Process ended prematurely: osmo-stp_10.42.42.5(pid=20084) [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20084)] [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:10:50.263161 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 12:10:50.290854 run osmo-hlr_10.42.42.2(pid=20081): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20081)] 12:10:50.340676 run osmo-hlr_10.42.42.2(pid=20081): stdout: | (launched: 2022-12-14_12:10:46.891753) 12:10:50.392319 run osmo-hlr_10.42.42.2(pid=20081): stderr: | [0;m[1;31m20221214121047233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121047233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121047233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121047233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121047233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121047234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121047251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121047260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121047260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121047260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:50.444291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20080): Terminating (SIGTERM) 12:10:50.486137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20083): Terminating (SIGTERM) 12:10:50.527937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20086): Terminating (SIGTERM) 12:10:50.570431 --- ParallelTerminationStrategy: PID 20080 died... 12:10:50.590587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20080): Terminated: ok {rc=0} 12:10:50.636483 --- ParallelTerminationStrategy: PID 20083 died... 12:10:50.656360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20083): Terminated: ok {rc=0} 12:10:50.702535 --- ParallelTerminationStrategy: PID 20086 died... 12:10:50.722132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20086): Terminated: ok {rc=0} 12:10:50.809764 bus /gobi_0: Setting Powered False 12:10:51.908698 bus /gobi_0: Setting Powered False 12:10:53.024724 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_sms:trx-lms --------------------------------------------------------------------- 12:10:54.279479 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:54.283737 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 12:10:54.317546 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 12:10:54.324873 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 12:10:54.377939 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 12:10:54.411516 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 12:10:54.418568 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 12:10:54.958488 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 12:10:54.964059 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 12:10:54.975349 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 12:10:55.025293 tst mo_mt_sms.py: using LAC 40805 12:10:55.150845 tst mo_mt_sms.py: using RAC 5 12:10:55.268793 tst mo_mt_sms.py: using CellId 40805 12:10:55.388784 tst mo_mt_sms.py: using BVCI 40806 12:10:55.496592 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 12:10:55.613428 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 12:10:55.730651 tst mo_mt_sms.py:9: start nitb and bts... 12:10:55.947526 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:10:56.597740 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20093): Launched 12:10:56.917006 run osmo-nitb_10.42.42.2(pid=20094): Launched 12:10:57.094168 run osmo-nitb_10.42.42.2(pid=20094): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20094)] 12:10:57.237094 run osmo-nitb_10.42.42.2(pid=20094): stdout: | (launched: 2022-12-14_12:10:56.858045) 12:10:57.381836 run osmo-nitb_10.42.42.2(pid=20094): stderr: | (launched: 2022-12-14_12:10:56.905408) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:10:57.526409 run osmo-nitb_10.42.42.2(pid=20094): stdout: | (launched: 2022-12-14_12:10:56.858045) 12:10:57.664831 run osmo-nitb_10.42.42.2(pid=20094): stderr: | (launched: 2022-12-14_12:10:56.905408) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20094) [trial-2404↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20094)] 12:10:58.037972 tst osmo-nitb_10.42.42.2(pid=20094): stdout: | (launched: 2022-12-14_12:10:56.858045) 12:10:58.166977 tst osmo-nitb_10.42.42.2(pid=20094): stderr: | (launched: 2022-12-14_12:10:56.905408) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:10:58.318324 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20094) [trial-2404↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20094)] [trial-2404↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 12:10:58.327703 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 12:10:58.335064 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20093): Terminating (SIGTERM) 12:10:58.545846 --- ParallelTerminationStrategy: PID 20093 died... 12:10:58.567748 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20093): Terminated: ok {rc=0} 12:10:58.655820 bus /sierra_3: Setting Powered False 12:10:59.755921 bus /sierra_3: Setting Powered False 12:11:00.874527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 sms:trx-lms --------------------------------------------------------------------- 12:11:02.108292 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:02.115745 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 12:11:02.160636 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:11:02.191028 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 12:11:02.250315 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 12:11:02.285316 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:11:02.313318 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 12:11:02.855364 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 12:11:02.860503 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:02.871097 tst sms:trx-lms: Using 1 x bts (candidates: 1) 12:11:02.919888 tst mo_mt_sms.py: using LAC 40806 12:11:03.046061 tst mo_mt_sms.py: using RAC 6 12:11:03.170681 tst mo_mt_sms.py: using CellId 40806 12:11:03.298297 tst mo_mt_sms.py: using BVCI 40807 12:11:03.415170 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:03.426327 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:03.437202 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:03.448157 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:03.459510 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:03.470917 tst sms:trx-lms: Using 1 x modem (candidates: 2) 12:11:03.586680 tst sms:trx-lms: Using 1 x modem (candidates: 2) 12:11:03.709398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:04.205186 run create_hlr_db(pid=20098): Launched 12:11:04.328158 bus /sierra_2: Setting Powered False 12:11:05.388240 run create_hlr_db(pid=20098): Terminated: ok {rc=0} 12:11:05.805272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20100): Launched 12:11:06.102976 run osmo-hlr_10.42.42.2(pid=20101): Launched 12:11:06.215916 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:06.728142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20103): Launched 12:11:07.025385 run osmo-stp_10.42.42.5(pid=20104): Launched 12:11:07.138843 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:07.679609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20106): Launched 12:11:07.980914 run osmo-msc_10.42.42.6(pid=20107): Launched 12:11:08.146761 run osmo-stp_10.42.42.5(pid=20104): ERR: Terminated: ERROR {rc=1} [trial-2404↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20104)] 12:11:08.274982 run osmo-stp_10.42.42.5(pid=20104): stdout: | (launched: 2022-12-14_12:11:06.970082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:08.401425 run osmo-stp_10.42.42.5(pid=20104): stderr: | [0;m[38;5;43m20221214121107140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121107140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121107140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121107141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121107141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121107141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121107141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:08.525952 run osmo-stp_10.42.42.5(pid=20104): stdout: | (launched: 2022-12-14_12:11:06.970082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:08.644782 run osmo-stp_10.42.42.5(pid=20104): stderr: | [0;m[38;5;43m20221214121107140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121107140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121107140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121107141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121107141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121107141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121107141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:08.787126 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20104): Process ended prematurely: osmo-stp_10.42.42.5(pid=20104) [trial-2404↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20104)] [trial-2404↪sms:trx-lms↪mo_mt_sms.py:16] 12:11:08.795628 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 12:11:08.821418 run osmo-hlr_10.42.42.2(pid=20101): ERR: Terminated: ERROR {rc=237} [trial-2404↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20101)] 12:11:08.869987 run osmo-hlr_10.42.42.2(pid=20101): stdout: | (launched: 2022-12-14_12:11:06.047688) 12:11:08.919596 run osmo-hlr_10.42.42.2(pid=20101): stderr: | [0;m[1;31m20221214121106226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121106226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121106226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121106226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121106226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121106226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121106238 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121106246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121106247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121106247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:08.988662 run osmo-msc_10.42.42.6(pid=20107): ERR: Terminated: ERROR {rc=2} [trial-2404↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20107)] 12:11:09.035874 run osmo-msc_10.42.42.6(pid=20107): stdout: | (launched: 2022-12-14_12:11:07.925376) 12:11:09.085428 run osmo-msc_10.42.42.6(pid=20107): stderr: | [0;m[38;5;43m20221214121108194 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121108194 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04f7ebec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121108195 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121108195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121108195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121108195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121108197 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121108197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121108197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121108197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:09.135277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20100): Terminating (SIGTERM) 12:11:09.175356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20103): Terminating (SIGTERM) 12:11:09.215740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20106): Terminating (SIGTERM) 12:11:09.256037 --- ParallelTerminationStrategy: PID 20100 died... 12:11:09.275491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20100): Terminated: ok {rc=0} 12:11:09.319799 --- ParallelTerminationStrategy: PID 20103 died... 12:11:09.338716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20103): Terminated: ok {rc=0} 12:11:09.382551 --- ParallelTerminationStrategy: PID 20106 died... 12:11:09.401527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20106): Terminated: ok {rc=0} 12:11:09.485945 bus /sierra_3: Setting Powered False 12:11:10.583978 bus /sierra_3: Setting Powered False 12:11:11.700443 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-lms --------------------------------------------------------------------- 12:11:12.931620 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:12.935467 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 12:11:12.967919 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 12:11:12.975536 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 12:11:13.010264 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 12:11:13.043109 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 12:11:13.049920 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 12:11:13.570725 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 12:11:13.575910 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 12:11:13.586735 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 12:11:13.634706 tst assert_extension.py: using LAC 40807 12:11:13.751962 tst assert_extension.py: using RAC 7 12:11:13.866336 tst assert_extension.py: using CellId 40807 12:11:13.991396 tst assert_extension.py: using BVCI 40808 12:11:14.106709 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 12:11:14.223275 tst assert_extension.py:10: start nitb and bts... 12:11:14.423073 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:11:15.034381 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20112): Launched 12:11:15.334627 run osmo-nitb_10.42.42.2(pid=20113): Launched 12:11:15.501607 run osmo-nitb_10.42.42.2(pid=20113): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20113)] 12:11:15.636245 run osmo-nitb_10.42.42.2(pid=20113): stdout: | (launched: 2022-12-14_12:11:15.278887) 12:11:15.772266 run osmo-nitb_10.42.42.2(pid=20113): stderr: | (launched: 2022-12-14_12:11:15.323198) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:11:15.934115 run osmo-nitb_10.42.42.2(pid=20113): stdout: | (launched: 2022-12-14_12:11:15.278887) 12:11:16.077383 run osmo-nitb_10.42.42.2(pid=20113): stderr: | (launched: 2022-12-14_12:11:15.323198) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20113): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20113) [trial-2404↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20113)] 12:11:16.449074 tst osmo-nitb_10.42.42.2(pid=20113): stdout: | (launched: 2022-12-14_12:11:15.278887) 12:11:16.581092 tst osmo-nitb_10.42.42.2(pid=20113): stderr: | (launched: 2022-12-14_12:11:15.323198) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:11:16.737300 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20113): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20113) [trial-2404↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20113)] [trial-2404↪nitb_ussd:trx-lms↪assert_extension.py:12] 12:11:16.747640 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:11:16.755247 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20112): Terminating (SIGTERM) 12:11:16.968379 --- ParallelTerminationStrategy: PID 20112 died... 12:11:16.991151 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20112): Terminated: ok {rc=0} 12:11:17.095958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 ussd:trx-lms --------------------------------------------------------------------- 12:11:18.286303 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:18.290639 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 12:11:18.324507 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:11:18.352377 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 12:11:18.391301 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 12:11:18.426039 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:11:18.453363 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 12:11:18.978715 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 ussd:trx-lms assert_extension.py ---------------------------------------------- 12:11:18.984164 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:18.995601 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 12:11:19.047177 tst assert_extension.py: using LAC 40808 12:11:19.164257 tst assert_extension.py: using RAC 8 12:11:19.279502 tst assert_extension.py: using CellId 40808 12:11:19.399067 tst assert_extension.py: using BVCI 40809 12:11:19.508053 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:19.518546 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:19.529179 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:19.539419 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:19.550312 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:11:19.561199 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 12:11:19.679397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:20.175821 run create_hlr_db(pid=20117): Launched 12:11:20.305556 bus /sierra_2: Setting Powered False 12:11:21.369076 run create_hlr_db(pid=20117): Terminated: ok {rc=0} 12:11:21.798631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20119): Launched 12:11:22.098756 run osmo-hlr_10.42.42.2(pid=20120): Launched 12:11:22.212372 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:22.740176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20122): Launched 12:11:23.039425 run osmo-stp_10.42.42.5(pid=20123): Launched 12:11:23.153197 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:23.690165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20125): Launched 12:11:23.989241 run osmo-msc_10.42.42.6(pid=20126): Launched 12:11:24.156006 run osmo-stp_10.42.42.5(pid=20123): ERR: Terminated: ERROR {rc=1} [trial-2404↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20123)] 12:11:24.283495 run osmo-stp_10.42.42.5(pid=20123): stdout: | (launched: 2022-12-14_12:11:22.983995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:24.409905 run osmo-stp_10.42.42.5(pid=20123): stderr: | [0;m[38;5;43m20221214121123154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121123155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121123155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121123155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121123156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121123156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121123156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:24.533826 run osmo-stp_10.42.42.5(pid=20123): stdout: | (launched: 2022-12-14_12:11:22.983995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:24.651805 run osmo-stp_10.42.42.5(pid=20123): stderr: | [0;m[38;5;43m20221214121123154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121123155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121123155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121123155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121123156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121123156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121123156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:24.793474 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20123): Process ended prematurely: osmo-stp_10.42.42.5(pid=20123) [trial-2404↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20123)] [trial-2404↪ussd:trx-lms↪assert_extension.py:17] 12:11:24.801731 tst assert_extension.py:17: Test FAILED (5.8 sec) 12:11:24.827728 run osmo-hlr_10.42.42.2(pid=20120): ERR: Terminated: ERROR {rc=237} [trial-2404↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20120)] 12:11:24.876012 run osmo-hlr_10.42.42.2(pid=20120): stdout: | (launched: 2022-12-14_12:11:22.043304) 12:11:24.925530 run osmo-hlr_10.42.42.2(pid=20120): stderr: | [0;m[1;31m20221214121122217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121122217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121122217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121122217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121122217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121122217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121122229 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121122237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121122238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121122238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:24.994725 run osmo-msc_10.42.42.6(pid=20126): ERR: Terminated: ERROR {rc=2} [trial-2404↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20126)] 12:11:25.042225 run osmo-msc_10.42.42.6(pid=20126): stdout: | (launched: 2022-12-14_12:11:23.932686) 12:11:25.091442 run osmo-msc_10.42.42.6(pid=20126): stderr: | [0;m[38;5;43m20221214121124204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121124204 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe71e4d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121124204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121124204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121124204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121124205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121124206 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121124207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121124207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121124207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:25.141350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20119): Terminating (SIGTERM) 12:11:25.181312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20122): Terminating (SIGTERM) 12:11:25.221276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20125): Terminating (SIGTERM) 12:11:25.261775 --- ParallelTerminationStrategy: PID 20119 died... 12:11:25.281123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20119): Terminated: ok {rc=0} 12:11:25.325125 --- ParallelTerminationStrategy: PID 20122 died... 12:11:25.343861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20122): Terminated: ok {rc=0} 12:11:25.387674 --- ParallelTerminationStrategy: PID 20125 died... 12:11:25.406438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20125): Terminated: ok {rc=0} 12:11:25.490012 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:11:26.698667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:26.705325 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:11:26.738188 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:11:26.765764 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:11:26.818466 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:11:26.853195 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:11:26.881030 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:11:27.429229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:11:27.479497 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:27.490893 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:11:27.558656 tst mo_mt_call.py: using LAC 40809 12:11:27.675165 tst mo_mt_call.py: using RAC 9 12:11:27.793646 tst mo_mt_call.py: using CellId 40809 12:11:27.923732 tst mo_mt_call.py: using BVCI 40810 12:11:28.043851 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:28.055671 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:28.067274 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:28.078955 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:28.090813 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:28.102372 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:11:28.221884 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:11:28.342268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:28.815277 run create_hlr_db(pid=20131): Launched 12:11:28.942932 bus /sierra_2: Setting Powered False 12:11:30.003376 run create_hlr_db(pid=20131): Terminated: ok {rc=0} 12:11:30.427408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20133): Launched 12:11:30.730590 run osmo-hlr_10.42.42.2(pid=20134): Launched 12:11:30.852525 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:31.611118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20136): Launched 12:11:31.996147 run osmo-stp_10.42.42.5(pid=20137): Launched 12:11:32.228471 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:32.873994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20139): Launched 12:11:33.199775 run osmo-msc_10.42.42.6(pid=20140): Launched 12:11:33.381375 run osmo-stp_10.42.42.5(pid=20137): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20137)] 12:11:33.517354 run osmo-stp_10.42.42.5(pid=20137): stdout: | (launched: 2022-12-14_12:11:31.938181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:33.653921 run osmo-stp_10.42.42.5(pid=20137): stderr: | [0;m[38;5;43m20221214121132277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121132277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121132278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121132278 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121132278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121132278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121132279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:33.790308 run osmo-stp_10.42.42.5(pid=20137): stdout: | (launched: 2022-12-14_12:11:31.938181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:33.918359 run osmo-stp_10.42.42.5(pid=20137): stderr: | [0;m[38;5;43m20221214121132277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121132277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121132278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121132278 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121132278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121132278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121132279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:34.072880 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20137): Process ended prematurely: osmo-stp_10.42.42.5(pid=20137) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20137)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:11:34.082799 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:11:34.110616 run osmo-hlr_10.42.42.2(pid=20134): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20134)] 12:11:34.160808 run osmo-hlr_10.42.42.2(pid=20134): stdout: | (launched: 2022-12-14_12:11:30.674338) 12:11:34.212606 run osmo-hlr_10.42.42.2(pid=20134): stderr: | [0;m[1;31m20221214121130884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121130884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121130884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121130884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121130884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121130884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121130911 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121130926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121130926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121130926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:34.284481 run osmo-msc_10.42.42.6(pid=20140): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20140)] 12:11:34.334417 run osmo-msc_10.42.42.6(pid=20140): stdout: | (launched: 2022-12-14_12:11:33.139889) 12:11:34.385929 run osmo-msc_10.42.42.6(pid=20140): stderr: | [0;m[38;5;43m20221214121133462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121133463 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c1432ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121133463 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121133463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121133463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121133463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121133465 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121133465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121133465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121133465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:34.437578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20133): Terminating (SIGTERM) 12:11:34.479231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20136): Terminating (SIGTERM) 12:11:34.521187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20139): Terminating (SIGTERM) 12:11:34.563228 --- ParallelTerminationStrategy: PID 20133 died... 12:11:34.583309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20133): Terminated: ok {rc=0} 12:11:34.629386 --- ParallelTerminationStrategy: PID 20136 died... 12:11:34.648793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20136): Terminated: ok {rc=0} 12:11:34.694669 --- ParallelTerminationStrategy: PID 20139 died... 12:11:34.714347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20139): Terminated: ok {rc=0} 12:11:34.803023 bus /sierra_3: Setting Powered False 12:11:35.902207 bus /sierra_3: Setting Powered False 12:11:37.019656 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:11:38.169258 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.181645 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:11:38.253721 tst mo_mt_call_osmux.py: using LAC 40810 12:11:38.380544 tst mo_mt_call_osmux.py: using RAC 10 12:11:38.507447 tst mo_mt_call_osmux.py: using CellId 40810 12:11:38.639597 tst mo_mt_call_osmux.py: using BVCI 40811 12:11:38.758129 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.769770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.781314 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.793248 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.804812 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.816324 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:11:38.933368 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:11:39.058363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:39.562398 run create_hlr_db(pid=20142): Launched 12:11:39.694638 bus /sierra_2: Setting Powered False 12:11:40.758935 run create_hlr_db(pid=20142): Terminated: ok {rc=0} 12:11:41.194162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20145): Launched 12:11:41.501201 run osmo-hlr_10.42.42.2(pid=20146): Launched 12:11:41.617456 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:42.158621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20148): Launched 12:11:42.463118 run osmo-stp_10.42.42.5(pid=20149): Launched 12:11:42.581086 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:43.132054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20151): Launched 12:11:43.437452 run osmo-msc_10.42.42.6(pid=20152): Launched 12:11:43.607032 run osmo-stp_10.42.42.5(pid=20149): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20149)] 12:11:43.736463 run osmo-stp_10.42.42.5(pid=20149): stdout: | (launched: 2022-12-14_12:11:42.406783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:43.865577 run osmo-stp_10.42.42.5(pid=20149): stderr: | [0;m[38;5;43m20221214121142579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121142579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121142580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121142580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121142581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121142581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121142582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:43.993109 run osmo-stp_10.42.42.5(pid=20149): stdout: | (launched: 2022-12-14_12:11:42.406783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:44.114157 run osmo-stp_10.42.42.5(pid=20149): stderr: | [0;m[38;5;43m20221214121142579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121142579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121142580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121142580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121142581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121142581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121142582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:44.259262 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20149): Process ended prematurely: osmo-stp_10.42.42.5(pid=20149) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20149)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:11:44.268493 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:11:44.295011 run osmo-hlr_10.42.42.2(pid=20146): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20146)] 12:11:44.344521 run osmo-hlr_10.42.42.2(pid=20146): stdout: | (launched: 2022-12-14_12:11:41.444568) 12:11:44.394507 run osmo-hlr_10.42.42.2(pid=20146): stderr: | [0;m[1;31m20221214121141623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121141623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121141623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121141623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121141623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121141623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121141635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121141644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121141644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121141645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:44.464663 run osmo-msc_10.42.42.6(pid=20152): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20152)] 12:11:44.512607 run osmo-msc_10.42.42.6(pid=20152): stdout: | (launched: 2022-12-14_12:11:43.380853) 12:11:44.562298 run osmo-msc_10.42.42.6(pid=20152): stderr: | [0;m[38;5;43m20221214121143653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121143653 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c81c16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121143653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121143653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121143653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121143653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121143655 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121143655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121143656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121143656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:44.612422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20145): Terminating (SIGTERM) 12:11:44.652883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20148): Terminating (SIGTERM) 12:11:44.693423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20151): Terminating (SIGTERM) 12:11:44.734586 --- ParallelTerminationStrategy: PID 20145 died... 12:11:44.754254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20145): Terminated: ok {rc=0} 12:11:44.798942 --- ParallelTerminationStrategy: PID 20148 died... 12:11:44.818075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20148): Terminated: ok {rc=0} 12:11:44.862201 --- ParallelTerminationStrategy: PID 20151 died... 12:11:44.881264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20151): Terminated: ok {rc=0} 12:11:44.967959 bus /sierra_3: Setting Powered False 12:11:46.077156 bus /sierra_3: Setting Powered False 12:11:47.219558 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:11:48.476040 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:48.484354 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:11:48.518371 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:11:48.545911 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:11:48.599705 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:11:48.633530 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:11:48.660734 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:11:49.213989 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:11:49.265792 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:49.277471 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:11:49.348145 tst mo_mt_call.py: using LAC 40811 12:11:49.475246 tst mo_mt_call.py: using RAC 11 12:11:49.603767 tst mo_mt_call.py: using CellId 40811 12:11:49.730376 tst mo_mt_call.py: using BVCI 40812 12:11:49.848272 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:49.859873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:49.871312 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:49.882707 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:49.894187 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:49.905558 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:11:50.024623 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:11:50.144830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:50.649449 run create_hlr_db(pid=20157): Launched 12:11:50.781621 bus /sierra_2: Setting Powered False 12:11:51.845457 run create_hlr_db(pid=20157): Terminated: ok {rc=0} 12:11:52.283416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20159): Launched 12:11:52.587950 run osmo-hlr_10.42.42.2(pid=20160): Launched 12:11:52.703188 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:53.232333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20162): Launched 12:11:53.536687 run osmo-stp_10.42.42.5(pid=20163): Launched 12:11:53.652560 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:54.201573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20165): Launched 12:11:54.505403 run osmo-msc_10.42.42.6(pid=20166): Launched 12:11:54.674977 run osmo-stp_10.42.42.5(pid=20163): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20163)] 12:11:54.804369 run osmo-stp_10.42.42.5(pid=20163): stdout: | (launched: 2022-12-14_12:11:53.480124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:54.933822 run osmo-stp_10.42.42.5(pid=20163): stderr: | [0;m[38;5;43m20221214121153654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121153654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121153654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121153655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121153655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121153656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121153656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:55.060705 run osmo-stp_10.42.42.5(pid=20163): stdout: | (launched: 2022-12-14_12:11:53.480124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:55.181352 run osmo-stp_10.42.42.5(pid=20163): stderr: | [0;m[38;5;43m20221214121153654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121153654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121153654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121153655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121153655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121153656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121153656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:55.325787 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20163): Process ended prematurely: osmo-stp_10.42.42.5(pid=20163) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20163)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:11:55.334711 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:11:55.361054 run osmo-hlr_10.42.42.2(pid=20160): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20160)] 12:11:55.409310 run osmo-hlr_10.42.42.2(pid=20160): stdout: | (launched: 2022-12-14_12:11:52.531349) 12:11:55.459022 run osmo-hlr_10.42.42.2(pid=20160): stderr: | [0;m[1;31m20221214121152708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121152708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121152708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121152708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121152708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121152708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121152720 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121152729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121152729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121152729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:55.528685 run osmo-msc_10.42.42.6(pid=20166): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20166)] 12:11:55.576266 run osmo-msc_10.42.42.6(pid=20166): stdout: | (launched: 2022-12-14_12:11:54.448883) 12:11:55.625705 run osmo-msc_10.42.42.6(pid=20166): stderr: | [0;m[38;5;43m20221214121154720 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121154721 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3076d51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121154721 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121154721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121154721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121154721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121154723 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121154723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121154723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121154723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:55.675654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20159): Terminating (SIGTERM) 12:11:55.715638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20162): Terminating (SIGTERM) 12:11:55.755545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20165): Terminating (SIGTERM) 12:11:55.795524 --- ParallelTerminationStrategy: PID 20159 died... 12:11:55.814818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20159): Terminated: ok {rc=0} 12:11:55.858921 --- ParallelTerminationStrategy: PID 20162 died... 12:11:55.877605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20162): Terminated: ok {rc=0} 12:11:55.921850 --- ParallelTerminationStrategy: PID 20165 died... 12:11:55.940719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20165): Terminated: ok {rc=0} 12:11:56.027302 bus /sierra_3: Setting Powered False 12:11:57.128582 bus /sierra_3: Setting Powered False 12:11:58.242297 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:11:59.391078 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:59.403448 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:11:59.475783 tst mo_mt_call_osmux.py: using LAC 40812 12:11:59.604745 tst mo_mt_call_osmux.py: using RAC 12 12:11:59.732855 tst mo_mt_call_osmux.py: using CellId 40812 12:11:59.860360 tst mo_mt_call_osmux.py: using BVCI 40813 12:11:59.978040 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:59.989827 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:00.001171 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:00.012435 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:00.024059 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:00.035526 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:12:00.153628 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:12:00.273045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:00.746862 run create_hlr_db(pid=20168): Launched 12:12:00.882921 bus /sierra_2: Setting Powered False 12:12:01.942142 run create_hlr_db(pid=20168): Terminated: ok {rc=0} 12:12:02.380238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20170): Launched 12:12:02.687191 run osmo-hlr_10.42.42.2(pid=20171): Launched 12:12:02.804624 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:03.332005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20173): Launched 12:12:03.636548 run osmo-stp_10.42.42.5(pid=20174): Launched 12:12:03.752299 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:04.303955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20176): Launched 12:12:04.610789 run osmo-msc_10.42.42.6(pid=20177): Launched 12:12:04.783255 run osmo-stp_10.42.42.5(pid=20174): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20174)] 12:12:04.914054 run osmo-stp_10.42.42.5(pid=20174): stdout: | (launched: 2022-12-14_12:12:03.580021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:05.043229 run osmo-stp_10.42.42.5(pid=20174): stderr: | [0;m[38;5;43m20221214121203753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121203754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121203754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121203754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121203755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121203755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121203755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:05.170293 run osmo-stp_10.42.42.5(pid=20174): stdout: | (launched: 2022-12-14_12:12:03.580021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:05.291211 run osmo-stp_10.42.42.5(pid=20174): stderr: | [0;m[38;5;43m20221214121203753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121203754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121203754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121203754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121203755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121203755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121203755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:05.435757 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20174): Process ended prematurely: osmo-stp_10.42.42.5(pid=20174) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20174)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:12:05.444830 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:12:05.471747 run osmo-hlr_10.42.42.2(pid=20171): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20171)] 12:12:05.520568 run osmo-hlr_10.42.42.2(pid=20171): stdout: | (launched: 2022-12-14_12:12:02.630184) 12:12:05.570614 run osmo-hlr_10.42.42.2(pid=20171): stderr: | [0;m[1;31m20221214121202812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121202812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121202812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121202812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121202812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121202812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121202825 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121202833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121202833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121202834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:05.641030 run osmo-msc_10.42.42.6(pid=20177): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20177)] 12:12:05.689042 run osmo-msc_10.42.42.6(pid=20177): stdout: | (launched: 2022-12-14_12:12:04.553992) 12:12:05.739281 run osmo-msc_10.42.42.6(pid=20177): stderr: | [0;m[38;5;43m20221214121204824 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121204825 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe323045c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121204825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121204825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121204825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121204825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121204827 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121204827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121204827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121204827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:05.789662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20170): Terminating (SIGTERM) 12:12:05.830210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20173): Terminating (SIGTERM) 12:12:05.870564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20176): Terminating (SIGTERM) 12:12:05.910942 --- ParallelTerminationStrategy: PID 20170 died... 12:12:05.930614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20170): Terminated: ok {rc=0} 12:12:05.975173 --- ParallelTerminationStrategy: PID 20173 died... 12:12:05.994206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20173): Terminated: ok {rc=0} 12:12:06.038520 --- ParallelTerminationStrategy: PID 20176 died... 12:12:06.057727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20176): Terminated: ok {rc=0} 12:12:06.145003 bus /sierra_3: Setting Powered False 12:12:07.247501 bus /sierra_3: Setting Powered False 12:12:08.365838 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:12:09.624582 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:12:09.631896 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:12:09.665712 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:12:09.693831 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:12:09.744865 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:12:09.779860 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:12:09.807881 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:12:10.360887 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:12:10.413919 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:10.425715 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:12:10.496163 tst mo_mt_call.py: using LAC 40813 12:12:10.623532 tst mo_mt_call.py: using RAC 13 12:12:10.742534 tst mo_mt_call.py: using CellId 40813 12:12:10.866081 tst mo_mt_call.py: using BVCI 40814 12:12:10.977941 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:10.989241 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:11.000224 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:11.011228 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:11.022521 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:11.033724 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:12:11.156697 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:12:11.275691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:11.749342 run create_hlr_db(pid=20184): Launched 12:12:11.865388 bus /sierra_2: Setting Powered False 12:12:12.926428 run create_hlr_db(pid=20184): Terminated: ok {rc=0} 12:12:13.375035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20186): Launched 12:12:13.704386 run osmo-hlr_10.42.42.2(pid=20187): Launched 12:12:13.830864 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:14.392105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20189): Launched 12:12:14.717108 run osmo-stp_10.42.42.5(pid=20190): Launched 12:12:14.843143 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:15.431803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20192): Launched 12:12:15.759961 run osmo-msc_10.42.42.6(pid=20193): Launched 12:12:16.036384 run osmo-stp_10.42.42.5(pid=20190): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20190)] 12:12:16.326940 run osmo-stp_10.42.42.5(pid=20190): stdout: | (launched: 2022-12-14_12:12:14.657101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:16.523068 run osmo-stp_10.42.42.5(pid=20190): stderr: | [0;m[38;5;43m20221214121214853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121214854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121214854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121214854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121214855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121214855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121214855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:16.669916 run osmo-stp_10.42.42.5(pid=20190): stdout: | (launched: 2022-12-14_12:12:14.657101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:16.797957 run osmo-stp_10.42.42.5(pid=20190): stderr: | [0;m[38;5;43m20221214121214853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121214854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121214854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121214854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121214855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121214855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121214855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:16.947060 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20190): Process ended prematurely: osmo-stp_10.42.42.5(pid=20190) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20190)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:12:16.956773 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:12:16.985462 run osmo-hlr_10.42.42.2(pid=20187): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20187)] 12:12:17.039526 run osmo-hlr_10.42.42.2(pid=20187): stdout: | (launched: 2022-12-14_12:12:13.644154) 12:12:17.093767 run osmo-hlr_10.42.42.2(pid=20187): stderr: | [0;m[1;31m20221214121213847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121213847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121213847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121213847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121213847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121213847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121213859 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121213869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121213869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121213869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:17.166066 run osmo-msc_10.42.42.6(pid=20193): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20193)] 12:12:17.217884 run osmo-msc_10.42.42.6(pid=20193): stdout: | (launched: 2022-12-14_12:12:15.698979) 12:12:17.270065 run osmo-msc_10.42.42.6(pid=20193): stderr: | [0;m[38;5;43m20221214121216098 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121216098 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb3b762fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121216098 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121216098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121216098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121216099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121216106 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121216106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121216106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121216107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:17.323132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20186): Terminating (SIGTERM) 12:12:17.366076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20189): Terminating (SIGTERM) 12:12:17.409365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20192): Terminating (SIGTERM) 12:12:17.450890 --- ParallelTerminationStrategy: PID 20186 died... 12:12:17.471169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20186): Terminated: ok {rc=0} 12:12:17.516552 --- ParallelTerminationStrategy: PID 20189 died... 12:12:17.536485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20189): Terminated: ok {rc=0} 12:12:17.582220 --- ParallelTerminationStrategy: PID 20192 died... 12:12:17.601936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20192): Terminated: ok {rc=0} 12:12:17.691170 bus /sierra_3: Setting Powered False 12:12:18.794391 bus /sierra_3: Setting Powered False 12:12:19.915090 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:12:21.066466 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.078875 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:12:21.150368 tst mo_mt_call_osmux.py: using LAC 40814 12:12:21.279209 tst mo_mt_call_osmux.py: using RAC 14 12:12:21.408344 tst mo_mt_call_osmux.py: using CellId 40814 12:12:21.536034 tst mo_mt_call_osmux.py: using BVCI 40815 12:12:21.653511 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.665091 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.676480 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.687810 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.699242 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.710614 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:12:21.828218 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:12:21.945176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:22.417099 run create_hlr_db(pid=20195): Launched 12:12:22.534073 bus /sierra_2: Setting Powered False 12:12:23.594772 run create_hlr_db(pid=20195): Terminated: ok {rc=0} 12:12:24.027768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20197): Launched 12:12:24.334443 run osmo-hlr_10.42.42.2(pid=20198): Launched 12:12:24.451097 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:24.989992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20200): Launched 12:12:25.296729 run osmo-stp_10.42.42.5(pid=20201): Launched 12:12:25.412630 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:25.964787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20203): Launched 12:12:26.290511 run osmo-msc_10.42.42.6(pid=20204): Launched 12:12:26.473305 run osmo-stp_10.42.42.5(pid=20201): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20201)] 12:12:26.611016 run osmo-stp_10.42.42.5(pid=20201): stdout: | (launched: 2022-12-14_12:12:25.240253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:26.748456 run osmo-stp_10.42.42.5(pid=20201): stderr: | [0;m[38;5;43m20221214121225413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121225413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121225414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121225414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121225415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121225415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121225415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:26.885750 run osmo-stp_10.42.42.5(pid=20201): stdout: | (launched: 2022-12-14_12:12:25.240253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:27.014599 run osmo-stp_10.42.42.5(pid=20201): stderr: | [0;m[38;5;43m20221214121225413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121225413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121225414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121225414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121225415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121225415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121225415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:27.169461 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20201): Process ended prematurely: osmo-stp_10.42.42.5(pid=20201) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20201)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:12:27.179210 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:12:27.207322 run osmo-hlr_10.42.42.2(pid=20198): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20198)] 12:12:27.257792 run osmo-hlr_10.42.42.2(pid=20198): stdout: | (launched: 2022-12-14_12:12:24.277335) 12:12:27.310334 run osmo-hlr_10.42.42.2(pid=20198): stderr: | [0;m[1;31m20221214121224457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121224457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121224457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121224457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121224457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121224457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121224470 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121224479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121224479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121224479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:27.383336 run osmo-msc_10.42.42.6(pid=20204): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20204)] 12:12:27.433797 run osmo-msc_10.42.42.6(pid=20204): stdout: | (launched: 2022-12-14_12:12:26.230337) 12:12:27.486055 run osmo-msc_10.42.42.6(pid=20204): stderr: | [0;m[38;5;43m20221214121226552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121226553 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f02fe2bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121226553 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121226553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121226553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121226553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121226555 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121226555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121226555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121226555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:27.538485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20197): Terminating (SIGTERM) 12:12:27.580610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20200): Terminating (SIGTERM) 12:12:27.622896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20203): Terminating (SIGTERM) 12:12:27.665339 --- ParallelTerminationStrategy: PID 20197 died... 12:12:27.685689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20197): Terminated: ok {rc=0} 12:12:27.732252 --- ParallelTerminationStrategy: PID 20200 died... 12:12:27.752157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20200): Terminated: ok {rc=0} 12:12:27.798662 --- ParallelTerminationStrategy: PID 20203 died... 12:12:27.818413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20203): Terminated: ok {rc=0} 12:12:27.907149 bus /sierra_3: Setting Powered False 12:12:29.006139 bus /sierra_3: Setting Powered False 12:12:30.122718 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:12:31.396034 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:12:31.404797 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:12:31.440153 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:12:31.469111 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:12:31.522532 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:12:31.557952 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:12:31.587817 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:12:32.154671 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:12:32.209505 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:32.221604 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:12:32.292916 tst mo_mt_call.py: using LAC 40815 12:12:32.413879 tst mo_mt_call.py: using RAC 15 12:12:32.535263 tst mo_mt_call.py: using CellId 40815 12:12:32.659612 tst mo_mt_call.py: using BVCI 40816 12:12:32.771417 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:32.782729 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:32.793876 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:32.804819 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:32.816021 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:32.827248 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:12:32.949866 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:12:33.070292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:33.575321 run create_hlr_db(pid=20209): Launched 12:12:33.709587 bus /sierra_2: Setting Powered False 12:12:34.774875 run create_hlr_db(pid=20209): Terminated: ok {rc=0} 12:12:35.210409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20211): Launched 12:12:35.515794 run osmo-hlr_10.42.42.2(pid=20212): Launched 12:12:35.632266 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:36.173185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20214): Launched 12:12:36.477539 run osmo-stp_10.42.42.5(pid=20215): Launched 12:12:36.596350 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:37.161332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20217): Launched 12:12:37.465330 run osmo-msc_10.42.42.6(pid=20218): Launched 12:12:37.638057 run osmo-stp_10.42.42.5(pid=20215): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20215)] 12:12:37.768009 run osmo-stp_10.42.42.5(pid=20215): stdout: | (launched: 2022-12-14_12:12:36.420743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:37.896896 run osmo-stp_10.42.42.5(pid=20215): stderr: | [0;m[38;5;43m20221214121236594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121236594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121236594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121236595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121236595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121236595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121236595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:38.024105 run osmo-stp_10.42.42.5(pid=20215): stdout: | (launched: 2022-12-14_12:12:36.420743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:38.145301 run osmo-stp_10.42.42.5(pid=20215): stderr: | [0;m[38;5;43m20221214121236594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121236594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121236594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121236595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121236595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121236595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121236595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:38.289611 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20215): Process ended prematurely: osmo-stp_10.42.42.5(pid=20215) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20215)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:12:38.298711 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:12:38.325603 run osmo-hlr_10.42.42.2(pid=20212): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20212)] 12:12:38.374763 run osmo-hlr_10.42.42.2(pid=20212): stdout: | (launched: 2022-12-14_12:12:35.459448) 12:12:38.425396 run osmo-hlr_10.42.42.2(pid=20212): stderr: | [0;m[1;31m20221214121235637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121235637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121235637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121235637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121235637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121235638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121235650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121235659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121235659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121235659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:38.495607 run osmo-msc_10.42.42.6(pid=20218): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20218)] 12:12:38.544238 run osmo-msc_10.42.42.6(pid=20218): stdout: | (launched: 2022-12-14_12:12:37.408716) 12:12:38.594632 run osmo-msc_10.42.42.6(pid=20218): stderr: | [0;m[38;5;43m20221214121237682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121237682 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f29b5282c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121237682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121237682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121237683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121237683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121237684 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121237685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121237685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121237685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:38.644741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20211): Terminating (SIGTERM) 12:12:38.685270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20214): Terminating (SIGTERM) 12:12:38.725518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20217): Terminating (SIGTERM) 12:12:38.766609 --- ParallelTerminationStrategy: PID 20211 died... 12:12:38.786566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20211): Terminated: ok {rc=0} 12:12:38.831150 --- ParallelTerminationStrategy: PID 20214 died... 12:12:38.850135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20214): Terminated: ok {rc=0} 12:12:38.894346 --- ParallelTerminationStrategy: PID 20217 died... 12:12:38.913465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20217): Terminated: ok {rc=0} 12:12:39.000331 bus /sierra_3: Setting Powered False 12:12:40.100585 bus /sierra_3: Setting Powered False 12:12:41.217574 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:12:42.365189 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:42.377268 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:12:42.447786 tst mo_mt_call_osmux.py: using LAC 40816 12:12:42.576197 tst mo_mt_call_osmux.py: using RAC 16 12:12:42.695247 tst mo_mt_call_osmux.py: using CellId 40816 12:12:42.814069 tst mo_mt_call_osmux.py: using BVCI 40817 12:12:42.926190 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:42.937501 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:42.948621 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:42.959692 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:42.971043 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:42.982378 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:12:43.099374 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:12:43.220448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:43.725216 run create_hlr_db(pid=20220): Launched 12:12:43.859295 bus /sierra_2: Setting Powered False 12:12:44.924482 run create_hlr_db(pid=20220): Terminated: ok {rc=0} 12:12:45.361581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20222): Launched 12:12:45.667304 run osmo-hlr_10.42.42.2(pid=20223): Launched 12:12:45.783048 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:46.485714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20225): Launched 12:12:46.841942 run osmo-stp_10.42.42.5(pid=20226): Launched 12:12:47.128713 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:47.705556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20228): Launched 12:12:48.011856 run osmo-msc_10.42.42.6(pid=20229): Launched 12:12:48.182294 run osmo-stp_10.42.42.5(pid=20226): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20226)] 12:12:48.312346 run osmo-stp_10.42.42.5(pid=20226): stdout: | (launched: 2022-12-14_12:12:46.771919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:48.442428 run osmo-stp_10.42.42.5(pid=20226): stderr: | [0;m[38;5;43m20221214121247029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121247029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121247029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121247030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121247030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121247030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121247030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:48.570467 run osmo-stp_10.42.42.5(pid=20226): stdout: | (launched: 2022-12-14_12:12:46.771919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:48.692517 run osmo-stp_10.42.42.5(pid=20226): stderr: | [0;m[38;5;43m20221214121247029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121247029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121247029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121247030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121247030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121247030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121247030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:48.838412 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20226): Process ended prematurely: osmo-stp_10.42.42.5(pid=20226) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20226)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:12:48.847645 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:12:48.874576 run osmo-hlr_10.42.42.2(pid=20223): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20223)] 12:12:48.923535 run osmo-hlr_10.42.42.2(pid=20223): stdout: | (launched: 2022-12-14_12:12:45.610777) 12:12:48.973867 run osmo-hlr_10.42.42.2(pid=20223): stderr: | [0;m[1;31m20221214121245786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121245786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121245786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121245786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121245786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121245786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121245799 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121245808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121245808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121245808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:49.044094 run osmo-msc_10.42.42.6(pid=20229): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20229)] 12:12:49.092146 run osmo-msc_10.42.42.6(pid=20229): stdout: | (launched: 2022-12-14_12:12:47.954921) 12:12:49.142245 run osmo-msc_10.42.42.6(pid=20229): stderr: | [0;m[38;5;43m20221214121248225 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121248225 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04382a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121248225 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121248225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121248225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121248226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121248229 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121248229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121248230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121248230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:49.192788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20222): Terminating (SIGTERM) 12:12:49.233483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20225): Terminating (SIGTERM) 12:12:49.273999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20228): Terminating (SIGTERM) 12:12:49.315381 --- ParallelTerminationStrategy: PID 20222 died... 12:12:49.335299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20222): Terminated: ok {rc=0} 12:12:49.380027 --- ParallelTerminationStrategy: PID 20225 died... 12:12:49.399078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20225): Terminated: ok {rc=0} 12:12:49.444161 --- ParallelTerminationStrategy: PID 20228 died... 12:12:49.463617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20228): Terminated: ok {rc=0} 12:12:49.550537 bus /sierra_3: Setting Powered False 12:12:50.651730 bus /sierra_3: Setting Powered False 12:12:51.768227 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:12:53.028140 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:12:53.034792 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:12:53.067526 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:12:53.095236 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:12:53.147305 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:12:53.180332 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:12:53.207721 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:12:53.759064 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:12:53.809319 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:12:53.820411 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:12:53.890381 tst mo_mt_call.py: using LAC 40817 12:12:54.018356 tst mo_mt_call.py: using RAC 17 12:12:54.144700 tst mo_mt_call.py: using CellId 40817 12:12:54.270909 tst mo_mt_call.py: using BVCI 40818 12:12:54.389443 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:12:54.401457 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:12:54.412933 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:12:54.424516 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:12:54.436384 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:12:54.448120 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:12:54.565038 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:12:54.685220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:55.190674 run create_hlr_db(pid=20235): Launched 12:12:55.324661 bus /sierra_2: Setting Powered False 12:12:56.388898 run create_hlr_db(pid=20235): Terminated: ok {rc=0} 12:12:56.843743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20237): Launched 12:12:57.171097 run osmo-hlr_10.42.42.2(pid=20238): Launched 12:12:57.295782 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:57.854550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20240): Launched 12:12:58.181325 run osmo-stp_10.42.42.5(pid=20241): Launched 12:12:58.306582 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:58.895525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20243): Launched 12:12:59.222896 run osmo-msc_10.42.42.6(pid=20244): Launched 12:12:59.404701 run osmo-stp_10.42.42.5(pid=20241): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20241)] 12:12:59.541274 run osmo-stp_10.42.42.5(pid=20241): stdout: | (launched: 2022-12-14_12:12:58.121342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:59.678323 run osmo-stp_10.42.42.5(pid=20241): stderr: | [0;m[38;5;43m20221214121258314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121258314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121258315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121258315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121258316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121258316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121258316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:59.815037 run osmo-stp_10.42.42.5(pid=20241): stdout: | (launched: 2022-12-14_12:12:58.121342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:59.944694 run osmo-stp_10.42.42.5(pid=20241): stderr: | [0;m[38;5;43m20221214121258314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121258314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121258315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121258315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121258316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121258316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121258316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:00.099695 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20241): Process ended prematurely: osmo-stp_10.42.42.5(pid=20241) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20241)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:13:00.109705 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:13:00.137718 run osmo-hlr_10.42.42.2(pid=20238): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20238)] 12:13:00.188427 run osmo-hlr_10.42.42.2(pid=20238): stdout: | (launched: 2022-12-14_12:12:57.111238) 12:13:00.240580 run osmo-hlr_10.42.42.2(pid=20238): stderr: | [0;m[1;31m20221214121257312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121257312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121257312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121257312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121257312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121257312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121257324 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121257332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121257332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121257332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:00.313194 run osmo-msc_10.42.42.6(pid=20244): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20244)] 12:13:00.363498 run osmo-msc_10.42.42.6(pid=20244): stdout: | (launched: 2022-12-14_12:12:59.162682) 12:13:00.415373 run osmo-msc_10.42.42.6(pid=20244): stderr: | [0;m[38;5;43m20221214121259484 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121259485 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbbc87d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121259485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121259485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121259485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121259485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121259487 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121259487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121259487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121259487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:00.467610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20237): Terminating (SIGTERM) 12:13:00.509660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20240): Terminating (SIGTERM) 12:13:00.551930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20243): Terminating (SIGTERM) 12:13:00.594534 --- ParallelTerminationStrategy: PID 20237 died... 12:13:00.614892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20237): Terminated: ok {rc=0} 12:13:00.661451 --- ParallelTerminationStrategy: PID 20240 died... 12:13:00.681268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20240): Terminated: ok {rc=0} 12:13:00.727883 --- ParallelTerminationStrategy: PID 20243 died... 12:13:00.747604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20243): Terminated: ok {rc=0} 12:13:00.836784 bus /sierra_3: Setting Powered False 12:13:01.934561 bus /sierra_3: Setting Powered False 12:13:03.051762 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:13:04.201892 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:04.214218 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:13:04.285499 tst mo_mt_call_osmux.py: using LAC 40818 12:13:04.417219 tst mo_mt_call_osmux.py: using RAC 18 12:13:04.548403 tst mo_mt_call_osmux.py: using CellId 40818 12:13:04.675099 tst mo_mt_call_osmux.py: using BVCI 40819 12:13:04.793676 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:04.805252 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:04.816528 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:04.827986 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:04.839384 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:04.850783 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:13:04.969680 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:13:05.090737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:05.594513 run create_hlr_db(pid=20246): Launched 12:13:05.727373 bus /sierra_2: Setting Powered False 12:13:06.792405 run create_hlr_db(pid=20246): Terminated: ok {rc=0} 12:13:07.229762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20248): Launched 12:13:07.536020 run osmo-hlr_10.42.42.2(pid=20249): Launched 12:13:07.651514 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:08.190954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20251): Launched 12:13:08.496463 run osmo-stp_10.42.42.5(pid=20252): Launched 12:13:08.612429 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:09.162834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20254): Launched 12:13:09.469555 run osmo-msc_10.42.42.6(pid=20255): Launched 12:13:09.640460 run osmo-stp_10.42.42.5(pid=20252): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20252)] 12:13:09.770602 run osmo-stp_10.42.42.5(pid=20252): stdout: | (launched: 2022-12-14_12:13:08.440151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:09.899923 run osmo-stp_10.42.42.5(pid=20252): stderr: | [0;m[38;5;43m20221214121308612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121308612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121308612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121308613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121308615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121308615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121308615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:10.027169 run osmo-stp_10.42.42.5(pid=20252): stdout: | (launched: 2022-12-14_12:13:08.440151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:10.147937 run osmo-stp_10.42.42.5(pid=20252): stderr: | [0;m[38;5;43m20221214121308612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121308612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121308612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121308613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121308615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121308615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121308615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:10.292344 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20252): Process ended prematurely: osmo-stp_10.42.42.5(pid=20252) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20252)] [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:13:10.301450 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:13:10.328502 run osmo-hlr_10.42.42.2(pid=20249): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20249)] 12:13:10.377365 run osmo-hlr_10.42.42.2(pid=20249): stdout: | (launched: 2022-12-14_12:13:07.478650) 12:13:10.427561 run osmo-hlr_10.42.42.2(pid=20249): stderr: | [0;m[1;31m20221214121307657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121307657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121307657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121307657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121307657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121307658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121307673 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121307683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121307684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121307684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:10.498045 run osmo-msc_10.42.42.6(pid=20255): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20255)] 12:13:10.546539 run osmo-msc_10.42.42.6(pid=20255): stdout: | (launched: 2022-12-14_12:13:09.412805) 12:13:10.596900 run osmo-msc_10.42.42.6(pid=20255): stderr: | [0;m[38;5;43m20221214121309686 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121309686 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6dcbe9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121309686 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121309686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121309687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121309687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121309688 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121309689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121309689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121309689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:10.647563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20248): Terminating (SIGTERM) 12:13:10.688114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20251): Terminating (SIGTERM) 12:13:10.728529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20254): Terminating (SIGTERM) 12:13:10.769337 --- ParallelTerminationStrategy: PID 20248 died... 12:13:10.789130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20248): Terminated: ok {rc=0} 12:13:10.834073 --- ParallelTerminationStrategy: PID 20251 died... 12:13:10.853315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20251): Terminated: ok {rc=0} 12:13:10.897709 --- ParallelTerminationStrategy: PID 20254 died... 12:13:10.916814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20254): Terminated: ok {rc=0} 12:13:11.001568 bus /sierra_3: Setting Powered False 12:13:12.101117 bus /sierra_3: Setting Powered False 12:13:13.217827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:13:14.464170 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:13:14.472181 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:13:14.506367 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:13:14.533830 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:13:14.584780 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:13:14.619143 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:13:14.646927 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:13:15.196846 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:13:15.246203 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:15.257388 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:13:15.325762 tst mo_mt_call.py: using LAC 40819 12:13:15.455931 tst mo_mt_call.py: using RAC 19 12:13:15.581904 tst mo_mt_call.py: using CellId 40819 12:13:15.706751 tst mo_mt_call.py: using BVCI 40820 12:13:15.826065 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:15.841824 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:15.854140 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:15.866298 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:15.883515 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:15.896723 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:13:16.028121 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:13:16.183533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:16.679222 run create_hlr_db(pid=20261): Launched 12:13:16.839833 bus /sierra_2: Setting Powered False 12:13:17.899759 run create_hlr_db(pid=20261): Terminated: ok {rc=0} 12:13:18.346428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Launched 12:13:18.674796 run osmo-hlr_10.42.42.2(pid=20264): Launched 12:13:18.798524 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:19.359665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Launched 12:13:19.685224 run osmo-stp_10.42.42.5(pid=20267): Launched 12:13:19.810081 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:20.397929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20269): Launched 12:13:20.723255 run osmo-msc_10.42.42.6(pid=20270): Launched 12:13:20.906280 run osmo-stp_10.42.42.5(pid=20267): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] 12:13:21.042467 run osmo-stp_10.42.42.5(pid=20267): stdout: | (launched: 2022-12-14_12:13:19.625347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:21.179982 run osmo-stp_10.42.42.5(pid=20267): stderr: | [0;m[38;5;43m20221214121319820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121319820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121319820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121319821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121319821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121319821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121319821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:21.316245 run osmo-stp_10.42.42.5(pid=20267): stdout: | (launched: 2022-12-14_12:13:19.625347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:21.444712 run osmo-stp_10.42.42.5(pid=20267): stderr: | [0;m[38;5;43m20221214121319820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121319820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121319820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121319821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121319821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121319821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121319821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:21.598930 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20267): Process ended prematurely: osmo-stp_10.42.42.5(pid=20267) [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:13:21.608423 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:13:21.636224 run osmo-hlr_10.42.42.2(pid=20264): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20264)] 12:13:21.686581 run osmo-hlr_10.42.42.2(pid=20264): stdout: | (launched: 2022-12-14_12:13:18.614100) 12:13:21.738576 run osmo-hlr_10.42.42.2(pid=20264): stderr: | [0;m[1;31m20221214121318813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121318814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121318814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121318814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121318814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121318814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121318827 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121318835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121318835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121318835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:21.811491 run osmo-msc_10.42.42.6(pid=20270): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20270)] 12:13:21.861696 run osmo-msc_10.42.42.6(pid=20270): stdout: | (launched: 2022-12-14_12:13:20.663220) 12:13:21.913582 run osmo-msc_10.42.42.6(pid=20270): stderr: | [0;m[38;5;43m20221214121320985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121320985 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f06eaefbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121320985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121320985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121320985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121320985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121320987 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121320987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121320988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121320988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:21.965586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Terminating (SIGTERM) 12:13:22.007580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Terminating (SIGTERM) 12:13:22.049624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20269): Terminating (SIGTERM) 12:13:22.091927 --- ParallelTerminationStrategy: PID 20263 died... 12:13:22.111889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Terminated: ok {rc=0} 12:13:22.158068 --- ParallelTerminationStrategy: PID 20266 died... 12:13:22.177475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Terminated: ok {rc=0} 12:13:22.223250 --- ParallelTerminationStrategy: PID 20269 died... 12:13:22.242882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20269): Terminated: ok {rc=0} 12:13:22.330714 bus /sierra_3: Setting Powered False 12:13:23.430357 bus /sierra_3: Setting Powered False 12:13:24.546794 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:13:25.697144 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:25.709498 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:13:25.781853 tst mo_mt_call_osmux.py: using LAC 40820 12:13:25.910681 tst mo_mt_call_osmux.py: using RAC 20 12:13:26.039447 tst mo_mt_call_osmux.py: using CellId 40820 12:13:26.166188 tst mo_mt_call_osmux.py: using BVCI 40821 12:13:26.284200 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.295942 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.307585 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.319120 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.330722 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.342219 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:13:26.459355 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:13:26.580889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:27.087853 run create_hlr_db(pid=20272): Launched 12:13:27.218807 bus /sierra_2: Setting Powered False 12:13:28.283181 run create_hlr_db(pid=20272): Terminated: ok {rc=0} 12:13:28.720761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20274): Launched 12:13:29.028462 run osmo-hlr_10.42.42.2(pid=20275): Launched 12:13:29.144748 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:29.673287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20277): Launched 12:13:29.977976 run osmo-stp_10.42.42.5(pid=20278): Launched 12:13:30.093938 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:30.650844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20280): Launched 12:13:30.970826 run osmo-msc_10.42.42.6(pid=20281): Launched 12:13:31.237981 run osmo-stp_10.42.42.5(pid=20278): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20278)] 12:13:31.406501 run osmo-stp_10.42.42.5(pid=20278): stdout: | (launched: 2022-12-14_12:13:29.921333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:31.676801 run osmo-stp_10.42.42.5(pid=20278): stderr: | [0;m[38;5;43m20221214121330095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121330095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121330095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121330096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121330096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121330097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121330097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:31.968329 run osmo-stp_10.42.42.5(pid=20278): stdout: | (launched: 2022-12-14_12:13:29.921333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:32.112782 run osmo-stp_10.42.42.5(pid=20278): stderr: | [0;m[38;5;43m20221214121330095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121330095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121330095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121330096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121330096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121330097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121330097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:32.263249 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20278): Process ended prematurely: osmo-stp_10.42.42.5(pid=20278) [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20278)] [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:13:32.273514 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:13:32.301735 run osmo-hlr_10.42.42.2(pid=20275): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20275)] 12:13:32.354771 run osmo-hlr_10.42.42.2(pid=20275): stdout: | (launched: 2022-12-14_12:13:28.971773) 12:13:32.406883 run osmo-hlr_10.42.42.2(pid=20275): stderr: | [0;m[1;31m20221214121329148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121329148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121329148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121329149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121329149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121329149 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121329160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121329168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121329168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121329168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:32.478862 run osmo-msc_10.42.42.6(pid=20281): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20281)] 12:13:32.526823 run osmo-msc_10.42.42.6(pid=20281): stdout: | (launched: 2022-12-14_12:13:30.910003) 12:13:32.577441 run osmo-msc_10.42.42.6(pid=20281): stderr: | [0;m[38;5;43m20221214121331508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121331508 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3472c6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121331508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121331508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121331509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121331509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121331512 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121331521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121331521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121331521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:32.628647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20274): Terminating (SIGTERM) 12:13:32.669531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20277): Terminating (SIGTERM) 12:13:32.710523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20280): Terminating (SIGTERM) 12:13:32.751723 --- ParallelTerminationStrategy: PID 20274 died... 12:13:32.771895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20274): Terminated: ok {rc=0} 12:13:32.816921 --- ParallelTerminationStrategy: PID 20277 died... 12:13:32.836715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20277): Terminated: ok {rc=0} 12:13:32.881614 --- ParallelTerminationStrategy: PID 20280 died... 12:13:32.901425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20280): Terminated: ok {rc=0} 12:13:32.990169 bus /sierra_3: Setting Powered False 12:13:34.091074 bus /sierra_3: Setting Powered False 12:13:35.202993 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:13:36.454181 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:13:36.459948 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:13:36.492335 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:13:36.519554 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:13:36.570856 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:13:36.603212 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:13:36.629695 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:13:37.179809 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:13:37.228667 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:37.239606 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:13:37.309734 tst mo_mt_call.py: using LAC 40821 12:13:37.431298 tst mo_mt_call.py: using RAC 21 12:13:37.550695 tst mo_mt_call.py: using CellId 40821 12:13:37.671364 tst mo_mt_call.py: using BVCI 40822 12:13:37.782984 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:37.793936 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:37.804689 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:37.815366 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:37.826330 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:37.837354 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:13:37.959116 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:13:38.076599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:38.548381 run create_hlr_db(pid=20286): Launched 12:13:38.664447 bus /sierra_2: Setting Powered False 12:13:39.728380 run create_hlr_db(pid=20286): Terminated: ok {rc=0} 12:13:40.184191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20288): Launched 12:13:40.510170 run osmo-hlr_10.42.42.2(pid=20289): Launched 12:13:40.636219 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:41.203520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20291): Launched 12:13:41.530107 run osmo-stp_10.42.42.5(pid=20292): Launched 12:13:41.654828 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:42.244237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20294): Launched 12:13:42.571067 run osmo-msc_10.42.42.6(pid=20295): Launched 12:13:42.754611 run osmo-stp_10.42.42.5(pid=20292): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20292)] 12:13:42.893245 run osmo-stp_10.42.42.5(pid=20292): stdout: | (launched: 2022-12-14_12:13:41.469944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:43.031054 run osmo-stp_10.42.42.5(pid=20292): stderr: | [0;m[38;5;43m20221214121341664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121341664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121341664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121341664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121341667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121341667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121341667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:43.168738 run osmo-stp_10.42.42.5(pid=20292): stdout: | (launched: 2022-12-14_12:13:41.469944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:43.298073 run osmo-stp_10.42.42.5(pid=20292): stderr: | [0;m[38;5;43m20221214121341664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121341664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121341664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121341664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121341667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121341667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121341667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:43.453472 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20292): Process ended prematurely: osmo-stp_10.42.42.5(pid=20292) [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20292)] [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:13:43.463109 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:13:43.490683 run osmo-hlr_10.42.42.2(pid=20289): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20289)] 12:13:43.540668 run osmo-hlr_10.42.42.2(pid=20289): stdout: | (launched: 2022-12-14_12:13:40.449938) 12:13:43.592561 run osmo-hlr_10.42.42.2(pid=20289): stderr: | [0;m[1;31m20221214121340651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121340651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121340651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121340652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121340652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121340652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121340664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121340674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121340674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121340674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:43.664926 run osmo-msc_10.42.42.6(pid=20295): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20295)] 12:13:43.714557 run osmo-msc_10.42.42.6(pid=20295): stdout: | (launched: 2022-12-14_12:13:42.510929) 12:13:43.766315 run osmo-msc_10.42.42.6(pid=20295): stderr: | [0;m[38;5;43m20221214121342832 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121342832 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c9150dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121342833 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121342833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121342833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121342833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121342835 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121342835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121342835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121342835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:43.818586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20288): Terminating (SIGTERM) 12:13:43.860542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20291): Terminating (SIGTERM) 12:13:43.902919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20294): Terminating (SIGTERM) 12:13:43.944902 --- ParallelTerminationStrategy: PID 20288 died... 12:13:43.965070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20288): Terminated: ok {rc=0} 12:13:44.011227 --- ParallelTerminationStrategy: PID 20291 died... 12:13:44.030732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20291): Terminated: ok {rc=0} 12:13:44.076641 --- ParallelTerminationStrategy: PID 20294 died... 12:13:44.096193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20294): Terminated: ok {rc=0} 12:13:44.184303 bus /sierra_3: Setting Powered False 12:13:45.283889 bus /sierra_3: Setting Powered False 12:13:46.412587 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:13:47.569506 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:47.581171 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:13:47.651329 tst mo_mt_call_osmux.py: using LAC 40822 12:13:47.770178 tst mo_mt_call_osmux.py: using RAC 22 12:13:47.894466 tst mo_mt_call_osmux.py: using CellId 40822 12:13:48.013393 tst mo_mt_call_osmux.py: using BVCI 40823 12:13:48.123405 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.134356 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.145153 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.155842 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.167006 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.178123 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:13:48.299313 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:13:48.418203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:48.888875 run create_hlr_db(pid=20297): Launched 12:13:49.004324 bus /sierra_2: Setting Powered False 12:13:50.065253 run create_hlr_db(pid=20297): Terminated: ok {rc=0} 12:13:50.512006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20299): Launched 12:13:50.840551 run osmo-hlr_10.42.42.2(pid=20300): Launched 12:13:50.966534 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:51.526683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20302): Launched 12:13:51.851950 run osmo-stp_10.42.42.5(pid=20303): Launched 12:13:51.976680 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:52.564726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20305): Launched 12:13:52.892857 run osmo-msc_10.42.42.6(pid=20306): Launched 12:13:53.074708 run osmo-stp_10.42.42.5(pid=20303): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20303)] 12:13:53.211717 run osmo-stp_10.42.42.5(pid=20303): stdout: | (launched: 2022-12-14_12:13:51.791422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:53.349276 run osmo-stp_10.42.42.5(pid=20303): stderr: | [0;m[38;5;43m20221214121351985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121351985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121351986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121351986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121351986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121351986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121351986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:53.485490 run osmo-stp_10.42.42.5(pid=20303): stdout: | (launched: 2022-12-14_12:13:51.791422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:53.614566 run osmo-stp_10.42.42.5(pid=20303): stderr: | [0;m[38;5;43m20221214121351985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121351985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121351986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121351986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121351986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121351986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121351986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:53.769045 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20303): Process ended prematurely: osmo-stp_10.42.42.5(pid=20303) [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20303)] [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:13:53.778656 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:13:53.806950 run osmo-hlr_10.42.42.2(pid=20300): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20300)] 12:13:53.857979 run osmo-hlr_10.42.42.2(pid=20300): stdout: | (launched: 2022-12-14_12:13:50.780104) 12:13:53.909802 run osmo-hlr_10.42.42.2(pid=20300): stderr: | [0;m[1;31m20221214121350981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121350981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121350982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121350982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121350982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121350982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121350995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121351003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121351003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121351004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:53.982084 run osmo-msc_10.42.42.6(pid=20306): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20306)] 12:13:54.032042 run osmo-msc_10.42.42.6(pid=20306): stdout: | (launched: 2022-12-14_12:13:52.832502) 12:13:54.083798 run osmo-msc_10.42.42.6(pid=20306): stderr: | [0;m[38;5;43m20221214121353158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121353158 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb46cd6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121353158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121353158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121353158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121353159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121353160 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121353161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121353161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121353161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:54.136095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20299): Terminating (SIGTERM) 12:13:54.178136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20302): Terminating (SIGTERM) 12:13:54.220050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20305): Terminating (SIGTERM) 12:13:54.262392 --- ParallelTerminationStrategy: PID 20299 died... 12:13:54.282034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20299): Terminated: ok {rc=0} 12:13:54.328399 --- ParallelTerminationStrategy: PID 20302 died... 12:13:54.348255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20302): Terminated: ok {rc=0} 12:13:54.394340 --- ParallelTerminationStrategy: PID 20305 died... 12:13:54.414045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20305): Terminated: ok {rc=0} 12:13:54.503613 bus /sierra_3: Setting Powered False 12:13:55.603906 bus /sierra_3: Setting Powered False 12:13:56.723636 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 emergency:trx-lms --------------------------------------------------------------------- 12:13:57.971703 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:13:57.976277 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 12:13:58.009131 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:13:58.036556 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 12:13:58.120800 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 12:13:58.153381 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:13:58.180177 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 12:13:58.762707 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2404 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 12:13:58.767716 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:13:58.778345 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 12:13:58.827192 tst emergency_mo_mt_call.py: using LAC 40823 12:13:58.954231 tst emergency_mo_mt_call.py: using RAC 23 12:13:59.080701 tst emergency_mo_mt_call.py: using CellId 40823 12:13:59.208195 tst emergency_mo_mt_call.py: using BVCI 40824 12:13:59.325641 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:13:59.336745 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:13:59.347709 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:13:59.358688 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:13:59.369615 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:13:59.380463 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:13:59.497455 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:13:59.615533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:00.112564 run create_hlr_db(pid=20311): Launched 12:14:00.243353 bus /sierra_2: Setting Powered False 12:14:01.315784 run create_hlr_db(pid=20311): Terminated: ok {rc=0} 12:14:01.768679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20313): Launched 12:14:02.103533 run osmo-hlr_10.42.42.2(pid=20314): Launched 12:14:02.258796 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:02.774674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20316): Launched 12:14:03.071841 run osmo-stp_10.42.42.5(pid=20317): Launched 12:14:03.195051 tst emergency_mo_mt_call.py: using MSISDN 8675 12:14:03.348394 run osmo-msc_10.42.42.6: Starting osmo-msc 12:14:03.884533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20319): Launched 12:14:04.183186 run osmo-msc_10.42.42.6(pid=20320): Launched 12:14:04.351814 run osmo-stp_10.42.42.5(pid=20317): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20317)] 12:14:04.479190 run osmo-stp_10.42.42.5(pid=20317): stdout: | (launched: 2022-12-14_12:14:03.016592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:04.606185 run osmo-stp_10.42.42.5(pid=20317): stderr: | [0;m[38;5;43m20221214121403188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121403188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121403189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121403189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121403190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121403190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121403190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:04.731066 run osmo-stp_10.42.42.5(pid=20317): stdout: | (launched: 2022-12-14_12:14:03.016592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:04.850046 run osmo-stp_10.42.42.5(pid=20317): stderr: | [0;m[38;5;43m20221214121403188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121403188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121403189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121403189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121403190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121403190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121403190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:04.991857 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20317): Process ended prematurely: osmo-stp_10.42.42.5(pid=20317) [trial-2404↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20317)] [trial-2404↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 12:14:05.000230 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 12:14:05.026111 run osmo-hlr_10.42.42.2(pid=20314): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20314)] 12:14:05.074318 run osmo-hlr_10.42.42.2(pid=20314): stdout: | (launched: 2022-12-14_12:14:02.044257) 12:14:05.124017 run osmo-hlr_10.42.42.2(pid=20314): stderr: | [0;m[1;31m20221214121402245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121402245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121402245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121402245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121402245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121402245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121402271 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121402281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121402282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121402282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:05.193261 run osmo-msc_10.42.42.6(pid=20320): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20320)] 12:14:05.241435 run osmo-msc_10.42.42.6(pid=20320): stdout: | (launched: 2022-12-14_12:14:04.127385) 12:14:05.290788 run osmo-msc_10.42.42.6(pid=20320): stderr: | [0;m[38;5;43m20221214121404400 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121404400 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f439d870c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121404400 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121404400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121404400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121404401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121404402 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121404403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121404403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121404403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:14:05.340509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20313): Terminating (SIGTERM) 12:14:05.380487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20316): Terminating (SIGTERM) 12:14:05.420742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20319): Terminating (SIGTERM) 12:14:05.461285 --- ParallelTerminationStrategy: PID 20313 died... 12:14:05.480792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20313): Terminated: ok {rc=0} 12:14:05.525337 --- ParallelTerminationStrategy: PID 20316 died... 12:14:05.544194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20316): Terminated: ok {rc=0} 12:14:05.588448 --- ParallelTerminationStrategy: PID 20319 died... 12:14:05.607473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20319): Terminated: ok {rc=0} 12:14:05.692604 bus /sierra_3: Setting Powered False 12:14:06.790840 bus /sierra_3: Setting Powered False 12:14:07.907241 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 12:14:08.994648 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:14:09.006401 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 12:14:09.058928 tst emergency_preemptive_call.py: using LAC 40824 12:14:09.184851 tst emergency_preemptive_call.py: using RAC 24 12:14:09.311200 tst emergency_preemptive_call.py: using CellId 40824 12:14:09.436309 tst emergency_preemptive_call.py: using BVCI 40825 12:14:09.551872 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:14:09.563130 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:14:09.574071 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:14:09.584905 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:14:09.595874 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:14:09.606777 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:14:09.723823 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:14:09.844025 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:14:09.960724 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:14:10.078661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:10.576826 run create_hlr_db(pid=20322): Launched 12:14:10.705614 bus /sierra_2: Setting Powered False 12:14:11.765855 run create_hlr_db(pid=20322): Terminated: ok {rc=0} 12:14:12.214241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20324): Launched 12:14:12.537749 run osmo-hlr_10.42.42.2(pid=20325): Launched 12:14:12.661305 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:13.212030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20327): Launched 12:14:13.533952 run osmo-stp_10.42.42.5(pid=20328): Launched 12:14:13.666328 tst emergency_preemptive_call.py: using MSISDN 8676 12:14:13.829176 run osmo-msc_10.42.42.6: Starting osmo-msc 12:14:14.403520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20330): Launched 12:14:14.724296 run osmo-msc_10.42.42.6(pid=20331): Launched 12:14:14.906453 run osmo-stp_10.42.42.5(pid=20328): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20328)] 12:14:15.041224 run osmo-stp_10.42.42.5(pid=20328): stdout: | (launched: 2022-12-14_12:14:13.474703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:15.176360 run osmo-stp_10.42.42.5(pid=20328): stderr: | [0;m[38;5;43m20221214121413670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121413670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121413670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121413671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121413671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121413671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121413671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:15.311081 run osmo-stp_10.42.42.5(pid=20328): stdout: | (launched: 2022-12-14_12:14:13.474703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:15.438175 run osmo-stp_10.42.42.5(pid=20328): stderr: | [0;m[38;5;43m20221214121413670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121413670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121413670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121413671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121413671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121413671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121413671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:15.589985 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20328): Process ended prematurely: osmo-stp_10.42.42.5(pid=20328) [trial-2404↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20328)] [trial-2404↪emergency:trx-lms↪emergency_preemptive_call.py:32] 12:14:15.599047 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 12:14:15.626493 run osmo-hlr_10.42.42.2(pid=20325): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20325)] 12:14:15.677049 run osmo-hlr_10.42.42.2(pid=20325): stdout: | (launched: 2022-12-14_12:14:12.478284) 12:14:15.729191 run osmo-hlr_10.42.42.2(pid=20325): stderr: | [0;m[1;31m20221214121412677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121412677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121412677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121412677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121412677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121412678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121412689 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121412697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121412698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121412698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:15.801866 run osmo-msc_10.42.42.6(pid=20331): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20331)] 12:14:15.861442 run osmo-msc_10.42.42.6(pid=20331): stdout: | (launched: 2022-12-14_12:14:14.664899) 12:14:15.926522 run osmo-msc_10.42.42.6(pid=20331): stderr: | [0;m[38;5;43m20221214121414986 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121414986 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff265e1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121414986 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121414986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121414987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121414987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121414989 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121414989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121414989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121414989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:14:15.980139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20324): Terminating (SIGTERM) 12:14:16.022969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20327): Terminating (SIGTERM) 12:14:16.065790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20330): Terminating (SIGTERM) 12:14:16.108843 --- ParallelTerminationStrategy: PID 20324 died... 12:14:16.129236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20324): Terminated: ok {rc=0} 12:14:16.176231 --- ParallelTerminationStrategy: PID 20327 died... 12:14:16.196541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20327): Terminated: ok {rc=0} 12:14:16.243722 --- ParallelTerminationStrategy: PID 20330 died... 12:14:16.264028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20330): Terminated: ok {rc=0} 12:14:16.354144 bus /sierra_9: Setting Powered False 12:14:17.453250 bus /sierra_9: Setting Powered False 12:14:18.569907 bus /sierra_8: Setting Powered False 12:14:19.669069 bus /sierra_8: Setting Powered False 12:14:20.784877 bus /sierra_3: Setting Powered False 12:14:21.884253 bus /sierra_3: Setting Powered False 12:14:23.001120 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-lms --------------------------------------------------------------------- 12:14:24.283161 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:14:24.287775 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 12:14:24.321286 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 12:14:24.360649 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 12:14:24.449738 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 12:14:24.483735 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 12:14:24.523329 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 12:14:25.116262 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 12:14:25.169080 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:25.179994 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:14:25.230608 tst cs_paging_gprs_active.py: using LAC 40825 12:14:25.358867 tst cs_paging_gprs_active.py: using RAC 25 12:14:25.491701 tst cs_paging_gprs_active.py: using CellId 40825 12:14:25.618437 tst cs_paging_gprs_active.py: using BVCI 40826 12:14:25.736052 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:25.747147 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:25.758014 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:25.768786 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:25.779687 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:25.790554 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:25.801571 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:25.812295 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:25.823590 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:14:25.941605 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:14:26.064303 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:14:26.286049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:26.614942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Launched 12:14:26.902737 run iperf3-srv_10.42.42.10(pid=20339): Launched 12:14:27.026791 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:14:27.246054 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:27.575340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20340): Launched 12:14:27.861690 run iperf3-srv_10.42.42.10(pid=20341): Launched 12:14:27.983660 tst cs_paging_gprs_active.py:38: start network... 12:14:28.204248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:28.710558 run create_hlr_db(pid=20342): Launched 12:14:28.843833 bus /sierra_2: Setting Powered False 12:14:29.907551 run create_hlr_db(pid=20342): Terminated: ok {rc=0} 12:14:30.343741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20344): Launched 12:14:30.650872 run osmo-hlr_10.42.42.2(pid=20345): Launched 12:14:30.767471 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:31.358755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20347): Launched 12:14:31.680893 run osmo-stp_10.42.42.5(pid=20348): Launched 12:14:31.912126 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:32.507512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20350): Launched 12:14:32.633550 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:32.910194 run patchelf(pid=20351): Launched 12:14:33.092810 run osmo-stp_10.42.42.5(pid=20348): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20348)] 12:14:33.230486 run osmo-stp_10.42.42.5(pid=20348): stdout: | (launched: 2022-12-14_12:14:31.623736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:33.370093 run osmo-stp_10.42.42.5(pid=20348): stderr: | [0;m[38;5;43m20221214121431803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121431803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121431804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121431804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121431804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121431805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121431805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:33.510336 run osmo-stp_10.42.42.5(pid=20348): stdout: | (launched: 2022-12-14_12:14:31.623736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:33.643795 run osmo-stp_10.42.42.5(pid=20348): stderr: | [0;m[38;5;43m20221214121431803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121431803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121431804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121431804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121431804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121431805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121431805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:33.801825 run patchelf(pid=20351): Terminating (SIGINT) 12:14:33.984361 run patchelf(pid=20351): Terminated: ok {rc=0} 12:14:34.116194 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20348): Process ended prematurely: osmo-stp_10.42.42.5(pid=20348) [trial-2404↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20348)] [trial-2404↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 12:14:34.126488 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 12:14:34.155037 run osmo-hlr_10.42.42.2(pid=20345): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20345)] 12:14:34.205644 run osmo-hlr_10.42.42.2(pid=20345): stdout: | (launched: 2022-12-14_12:14:30.593765) 12:14:34.257352 run osmo-hlr_10.42.42.2(pid=20345): stderr: | [0;m[1;31m20221214121430770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121430770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121430770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121430770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121430770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121430770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121430783 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121430794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121430794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121430794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:34.309592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Terminating (SIGTERM) 12:14:34.351567 run iperf3-srv_10.42.42.10(pid=20339): Terminating (SIGTERM) 12:14:34.393572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20340): Terminating (SIGTERM) 12:14:34.435934 run iperf3-srv_10.42.42.10(pid=20341): Terminating (SIGTERM) 12:14:34.477829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20344): Terminating (SIGTERM) 12:14:34.519877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20347): Terminating (SIGTERM) 12:14:34.561826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20350): Terminating (SIGTERM) 12:14:34.603928 --- ParallelTerminationStrategy: PID 20338 died... 12:14:34.624145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Terminated: ok {rc=0} 12:14:34.670558 --- ParallelTerminationStrategy: PID 20339 died... 12:14:34.690654 run iperf3-srv_10.42.42.10(pid=20339): Terminated {rc=256} 12:14:34.736863 --- ParallelTerminationStrategy: PID 20340 died... 12:14:34.757223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20340): Terminated: ok {rc=0} 12:14:34.803346 --- ParallelTerminationStrategy: PID 20341 died... 12:14:34.823058 run iperf3-srv_10.42.42.10(pid=20341): Terminated {rc=256} 12:14:34.869270 --- ParallelTerminationStrategy: PID 20344 died... 12:14:34.889099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20344): Terminated: ok {rc=0} 12:14:34.935102 --- ParallelTerminationStrategy: PID 20347 died... 12:14:34.954789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20347): Terminated: ok {rc=0} 12:14:35.001171 --- ParallelTerminationStrategy: PID 20350 died... 12:14:35.020683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20350): Terminated: ok {rc=0} 12:14:35.109387 bus /gobi_0: Setting Powered False 12:14:36.209367 bus /gobi_0: Setting Powered False 12:14:37.325832 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms iperf3.py ---------------------------------------------- 12:14:38.475510 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:38.487116 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:14:38.540047 tst iperf3.py: using LAC 40826 12:14:38.669328 tst iperf3.py: using RAC 26 12:14:38.796580 tst iperf3.py: using CellId 40826 12:14:38.925249 tst iperf3.py: using BVCI 40827 12:14:39.045029 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:39.056083 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:39.066975 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:39.077856 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:39.088557 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:39.099478 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:39.110440 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:39.121292 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:39.132219 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:14:39.249885 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:14:39.454901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:39.762460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20352): Launched 12:14:40.030465 run iperf3-srv_10.42.42.10(pid=20353): Launched 12:14:40.144760 tst iperf3.py:8: start network... 12:14:40.348286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:40.821144 run create_hlr_db(pid=20354): Launched 12:14:40.938813 bus /gobi_6: Setting Powered False 12:14:41.999471 run create_hlr_db(pid=20354): Terminated: ok {rc=0} 12:14:42.446820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20356): Launched 12:14:42.774597 run osmo-hlr_10.42.42.2(pid=20357): Launched 12:14:42.901454 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:43.470215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20359): Launched 12:14:43.796771 run osmo-stp_10.42.42.5(pid=20360): Launched 12:14:43.921487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:44.485128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20362): Launched 12:14:44.611009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:44.887738 run patchelf(pid=20363): Launched 12:14:45.070526 run osmo-stp_10.42.42.5(pid=20360): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20360)] 12:14:45.208450 run osmo-stp_10.42.42.5(pid=20360): stdout: | (launched: 2022-12-14_12:14:43.736360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:45.347907 run osmo-stp_10.42.42.5(pid=20360): stderr: | [0;m[38;5;43m20221214121443930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121443930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121443930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121443930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121443933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121443933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121443933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:45.487367 run osmo-stp_10.42.42.5(pid=20360): stdout: | (launched: 2022-12-14_12:14:43.736360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:45.621771 run osmo-stp_10.42.42.5(pid=20360): stderr: | [0;m[38;5;43m20221214121443930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121443930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121443930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121443930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121443933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121443933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121443933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:45.779624 run patchelf(pid=20363): Terminating (SIGINT) 12:14:45.989861 run patchelf(pid=20363): Terminated: ok {rc=0} 12:14:46.122387 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20360): Process ended prematurely: osmo-stp_10.42.42.5(pid=20360) [trial-2404↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20360)] [trial-2404↪gprs:trx-lms↪iperf3.py:8] 12:14:46.133439 tst iperf3.py:8: Test FAILED (7.7 sec) 12:14:46.162326 run osmo-hlr_10.42.42.2(pid=20357): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20357)] 12:14:46.217200 run osmo-hlr_10.42.42.2(pid=20357): stdout: | (launched: 2022-12-14_12:14:42.714243) 12:14:46.270709 run osmo-hlr_10.42.42.2(pid=20357): stderr: | [0;m[1;31m20221214121442914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121442914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121442914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121442914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121442914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121442914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121442927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121442935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121442935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121442935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:46.324326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20352): Terminating (SIGTERM) 12:14:46.367217 run iperf3-srv_10.42.42.10(pid=20353): Terminating (SIGTERM) 12:14:46.412057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20356): Terminating (SIGTERM) 12:14:46.455543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20359): Terminating (SIGTERM) 12:14:46.499485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20362): Terminating (SIGTERM) 12:14:46.546149 --- ParallelTerminationStrategy: PID 20352 died... 12:14:46.568213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20352): Terminated: ok {rc=0} 12:14:46.619389 --- ParallelTerminationStrategy: PID 20353 died... 12:14:46.639729 run iperf3-srv_10.42.42.10(pid=20353): Terminated {rc=256} 12:14:46.688837 --- ParallelTerminationStrategy: PID 20356 died... 12:14:46.709540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20356): Terminated: ok {rc=0} 12:14:46.757146 --- ParallelTerminationStrategy: PID 20359 died... 12:14:46.778342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20359): Terminated: ok {rc=0} 12:14:46.826797 --- ParallelTerminationStrategy: PID 20362 died... 12:14:46.847368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20362): Terminated: ok {rc=0} 12:14:46.942715 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms iperf3m4.py ---------------------------------------------- 12:14:48.103516 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:48.115293 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:14:48.170543 tst iperf3m4.py: using LAC 40827 12:14:48.302586 tst iperf3m4.py: using RAC 27 12:14:48.430299 tst iperf3m4.py: using CellId 40827 12:14:48.555990 tst iperf3m4.py: using BVCI 40828 12:14:48.674336 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:48.685463 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:48.696319 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:48.707198 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:48.718023 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:48.728839 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:48.739870 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:48.750672 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:14:48.761689 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:14:48.880812 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:14:49.006785 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:14:49.124349 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:14:49.241511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:14:49.446617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:49.754631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20364): Launched 12:14:50.021290 run iperf3-srv_10.42.42.10(pid=20365): Launched 12:14:50.137498 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:14:50.340460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:50.646468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20366): Launched 12:14:50.914670 run iperf3-srv_10.42.42.10(pid=20367): Launched 12:14:51.030740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:14:51.233684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:51.539073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20368): Launched 12:14:51.806632 run iperf3-srv_10.42.42.10(pid=20369): Launched 12:14:51.922286 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:14:52.125048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:52.430125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20370): Launched 12:14:52.697593 run iperf3-srv_10.42.42.10(pid=20371): Launched 12:14:52.811312 tst iperf3m4.py:8: start network... 12:14:53.014420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:53.484865 run create_hlr_db(pid=20372): Launched 12:14:53.601238 bus /gobi_6: Setting Powered False 12:14:54.662117 run create_hlr_db(pid=20372): Terminated: ok {rc=0} 12:14:55.087377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20374): Launched 12:14:55.394424 run osmo-hlr_10.42.42.2(pid=20375): Launched 12:14:55.511650 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:56.051466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20377): Launched 12:14:56.358827 run osmo-stp_10.42.42.5(pid=20378): Launched 12:14:56.477268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:57.002809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20380): Launched 12:14:57.119075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:57.376468 run patchelf(pid=20381): Launched 12:14:57.547333 run osmo-stp_10.42.42.5(pid=20378): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20378)] 12:14:57.677231 run osmo-stp_10.42.42.5(pid=20378): stdout: | (launched: 2022-12-14_12:14:56.301821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:57.807958 run osmo-stp_10.42.42.5(pid=20378): stderr: | [0;m[38;5;43m20221214121456470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121456470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121456470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121456470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121456471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121456471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121456471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:57.938958 run osmo-stp_10.42.42.5(pid=20378): stdout: | (launched: 2022-12-14_12:14:56.301821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:58.063747 run osmo-stp_10.42.42.5(pid=20378): stderr: | [0;m[38;5;43m20221214121456470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121456470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121456470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121456470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121456471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121456471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121456471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:58.211375 run patchelf(pid=20381): Terminating (SIGINT) 12:14:58.381868 run patchelf(pid=20381): Terminated: ok {rc=0} 12:14:58.505071 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20378): Process ended prematurely: osmo-stp_10.42.42.5(pid=20378) [trial-2404↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20378)] [trial-2404↪gprs:trx-lms↪iperf3m4.py:8] 12:14:58.514665 tst iperf3m4.py:8: Test FAILED (10.5 sec) 12:14:58.542229 run osmo-hlr_10.42.42.2(pid=20375): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20375)] 12:14:58.590879 run osmo-hlr_10.42.42.2(pid=20375): stdout: | (launched: 2022-12-14_12:14:55.337261) 12:14:58.640536 run osmo-hlr_10.42.42.2(pid=20375): stderr: | [0;m[1;31m20221214121455511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121455511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121455511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121455511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121455511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121455511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121455523 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121455531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121455532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121455532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:58.690540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20364): Terminating (SIGTERM) 12:14:58.730738 run iperf3-srv_10.42.42.10(pid=20365): Terminating (SIGTERM) 12:14:58.770759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20366): Terminating (SIGTERM) 12:14:58.811096 run iperf3-srv_10.42.42.10(pid=20367): Terminating (SIGTERM) 12:14:58.851240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20368): Terminating (SIGTERM) 12:14:58.891892 run iperf3-srv_10.42.42.10(pid=20369): Terminating (SIGTERM) 12:14:58.932068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20370): Terminating (SIGTERM) 12:14:58.972111 run iperf3-srv_10.42.42.10(pid=20371): Terminating (SIGTERM) 12:14:59.012175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20374): Terminating (SIGTERM) 12:14:59.052561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20377): Terminating (SIGTERM) 12:14:59.092650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20380): Terminating (SIGTERM) 12:14:59.133172 --- ParallelTerminationStrategy: PID 20364 died... 12:14:59.152500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20364): Terminated: ok {rc=0} 12:14:59.196832 --- ParallelTerminationStrategy: PID 20365 died... 12:14:59.216114 run iperf3-srv_10.42.42.10(pid=20365): Terminated {rc=256} 12:14:59.259947 --- ParallelTerminationStrategy: PID 20366 died... 12:14:59.278730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20366): Terminated: ok {rc=0} 12:14:59.322552 --- ParallelTerminationStrategy: PID 20367 died... 12:14:59.341307 run iperf3-srv_10.42.42.10(pid=20367): Terminated {rc=256} 12:14:59.385197 --- ParallelTerminationStrategy: PID 20368 died... 12:14:59.403896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20368): Terminated: ok {rc=0} 12:14:59.447651 --- ParallelTerminationStrategy: PID 20369 died... 12:14:59.466451 run iperf3-srv_10.42.42.10(pid=20369): Terminated {rc=256} 12:14:59.510127 --- ParallelTerminationStrategy: PID 20370 died... 12:14:59.529012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20370): Terminated: ok {rc=0} 12:14:59.572802 --- ParallelTerminationStrategy: PID 20371 died... 12:14:59.592050 run iperf3-srv_10.42.42.10(pid=20371): Terminated {rc=256} 12:14:59.635943 --- ParallelTerminationStrategy: PID 20374 died... 12:14:59.654908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20374): Terminated: ok {rc=0} 12:14:59.699239 --- ParallelTerminationStrategy: PID 20377 died... 12:14:59.718117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20377): Terminated: ok {rc=0} 12:14:59.761974 --- ParallelTerminationStrategy: PID 20380 died... 12:14:59.780753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20380): Terminated: ok {rc=0} 12:14:59.866938 bus /gobi_4: Setting Powered False 12:15:00.969061 bus /gobi_4: Setting Powered False 12:15:02.121031 bus /gobi_1: Setting Powered False 12:15:03.223330 bus /gobi_1: Setting Powered False 12:15:04.339265 bus /gobi_0: Setting Powered False 12:15:05.436822 bus /gobi_0: Setting Powered False 12:15:06.554529 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms ping.py ---------------------------------------------- 12:15:07.658585 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:07.669881 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:15:07.719067 tst ping.py: using LAC 40828 12:15:07.845699 tst ping.py: using RAC 28 12:15:07.972691 tst ping.py: using CellId 40828 12:15:08.101678 tst ping.py: using BVCI 40829 12:15:08.219016 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:08.230299 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:08.241460 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:08.252392 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:08.263434 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:08.274452 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:08.285609 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:08.296606 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:15:08.413273 tst ping.py:19: start network... 12:15:08.611809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:09.072116 run create_hlr_db(pid=20385): Launched 12:15:09.186598 bus /gobi_6: Setting Powered False 12:15:10.246421 run create_hlr_db(pid=20385): Terminated: ok {rc=0} 12:15:10.686521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20387): Launched 12:15:11.006584 run osmo-hlr_10.42.42.2(pid=20388): Launched 12:15:11.129869 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:11.686130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20390): Launched 12:15:12.008792 run osmo-stp_10.42.42.5(pid=20391): Launched 12:15:12.130446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:12.682337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20393): Launched 12:15:12.805758 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:13.077644 run patchelf(pid=20394): Launched 12:15:13.255475 run osmo-stp_10.42.42.5(pid=20391): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20391)] 12:15:13.391780 run osmo-stp_10.42.42.5(pid=20391): stdout: | (launched: 2022-12-14_12:15:11.948845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:13.529989 run osmo-stp_10.42.42.5(pid=20391): stderr: | [0;m[38;5;43m20221214121512141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121512142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121512142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121512142 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121512143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121512143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121512143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:13.668009 run osmo-stp_10.42.42.5(pid=20391): stdout: | (launched: 2022-12-14_12:15:11.948845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:13.799909 run osmo-stp_10.42.42.5(pid=20391): stderr: | [0;m[38;5;43m20221214121512141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121512142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121512142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121512142 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121512143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121512143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121512143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:13.956435 run patchelf(pid=20394): Terminating (SIGINT) 12:15:14.136812 run patchelf(pid=20394): Terminated: ok {rc=0} 12:15:14.266981 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20391): Process ended prematurely: osmo-stp_10.42.42.5(pid=20391) [trial-2404↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20391)] [trial-2404↪gprs:trx-lms↪ping.py:22] 12:15:14.276691 tst ping.py:22: Test FAILED (6.6 sec) 12:15:14.305026 run osmo-hlr_10.42.42.2(pid=20388): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20388)] 12:15:14.355906 run osmo-hlr_10.42.42.2(pid=20388): stdout: | (launched: 2022-12-14_12:15:10.947316) 12:15:14.408414 run osmo-hlr_10.42.42.2(pid=20388): stderr: | [0;m[1;31m20221214121511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121511157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121511165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121511165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121511165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:14.461324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20387): Terminating (SIGTERM) 12:15:14.503654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20390): Terminating (SIGTERM) 12:15:14.546209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20393): Terminating (SIGTERM) 12:15:14.588835 --- ParallelTerminationStrategy: PID 20387 died... 12:15:14.609527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20387): Terminated: ok {rc=0} 12:15:14.656321 --- ParallelTerminationStrategy: PID 20390 died... 12:15:14.676455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20390): Terminated: ok {rc=0} 12:15:14.723187 --- ParallelTerminationStrategy: PID 20393 died... 12:15:14.743274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20393): Terminated: ok {rc=0} 12:15:14.831558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 12:15:15.923343 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:15.935779 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:15:15.988753 tst ping_idle_ping.py: using LAC 40829 12:15:16.125091 tst ping_idle_ping.py: using RAC 29 12:15:16.284170 tst ping_idle_ping.py: using CellId 40829 12:15:16.407148 tst ping_idle_ping.py: using BVCI 40830 12:15:16.526864 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:16.539040 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:16.551329 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:16.563265 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:16.575232 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:16.587092 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:16.599201 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:15:16.610758 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:15:16.735222 tst ping_idle_ping.py:24: start network... 12:15:16.946860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:17.489738 run create_hlr_db(pid=20395): Launched 12:15:17.604683 bus /gobi_6: Setting Powered False 12:15:18.664706 run create_hlr_db(pid=20395): Terminated: ok {rc=0} 12:15:19.087400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20397): Launched 12:15:19.388636 run osmo-hlr_10.42.42.2(pid=20399): Launched 12:15:19.503233 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:20.034162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20401): Launched 12:15:20.334130 run osmo-stp_10.42.42.5(pid=20402): Launched 12:15:20.448418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:20.965542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20404): Launched 12:15:21.080236 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:21.334159 run patchelf(pid=20405): Launched 12:15:21.500634 run osmo-stp_10.42.42.5(pid=20402): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20402)] 12:15:21.627932 run osmo-stp_10.42.42.5(pid=20402): stdout: | (launched: 2022-12-14_12:15:20.278142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:21.757423 run osmo-stp_10.42.42.5(pid=20402): stderr: | [0;m[38;5;43m20221214121520450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121520450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121520450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121520451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121520451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121520451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121520451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:21.887806 run osmo-stp_10.42.42.5(pid=20402): stdout: | (launched: 2022-12-14_12:15:20.278142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:22.010647 run osmo-stp_10.42.42.5(pid=20402): stderr: | [0;m[38;5;43m20221214121520450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121520450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121520450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121520451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121520451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121520451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121520451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:22.156081 run patchelf(pid=20405): Terminating (SIGINT) 12:15:22.325138 run patchelf(pid=20405): Terminated: ok {rc=0} 12:15:22.446735 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20402): Process ended prematurely: osmo-stp_10.42.42.5(pid=20402) [trial-2404↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20402)] [trial-2404↪gprs:trx-lms↪ping_idle_ping.py:27] 12:15:22.455773 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:15:22.482595 run osmo-hlr_10.42.42.2(pid=20399): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20399)] 12:15:22.531027 run osmo-hlr_10.42.42.2(pid=20399): stdout: | (launched: 2022-12-14_12:15:19.332576) 12:15:22.580819 run osmo-hlr_10.42.42.2(pid=20399): stderr: | [0;m[1;31m20221214121519509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121519509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121519509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121519509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121519509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121519509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121519521 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121519530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121519530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121519530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:22.630954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20397): Terminating (SIGTERM) 12:15:22.671200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20401): Terminating (SIGTERM) 12:15:22.711305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20404): Terminating (SIGTERM) 12:15:22.751810 --- ParallelTerminationStrategy: PID 20397 died... 12:15:22.771271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20397): Terminated: ok {rc=0} 12:15:22.815982 --- ParallelTerminationStrategy: PID 20401 died... 12:15:22.835065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20401): Terminated: ok {rc=0} 12:15:22.879311 --- ParallelTerminationStrategy: PID 20404 died... 12:15:22.898379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20404): Terminated: ok {rc=0} 12:15:22.985215 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 12:15:24.293116 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:15:24.299465 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:15:24.334044 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:15:24.374627 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:15:24.464115 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:15:24.498087 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:15:24.537410 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:15:25.132215 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:15:25.184018 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:25.195030 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:15:25.245329 tst cs_paging_gprs_active.py: using LAC 40830 12:15:25.367710 tst cs_paging_gprs_active.py: using RAC 30 12:15:25.487841 tst cs_paging_gprs_active.py: using CellId 40830 12:15:25.616833 tst cs_paging_gprs_active.py: using BVCI 40831 12:15:25.735107 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:25.746479 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:25.757652 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:25.768757 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:25.779832 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:25.790978 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:25.802287 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:25.813328 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:25.824623 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:25.946974 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:26.065676 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:15:26.272259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:26.583030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20410): Launched 12:15:26.855426 run iperf3-srv_10.42.42.10(pid=20411): Launched 12:15:26.972624 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:15:27.177559 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:27.486558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20412): Launched 12:15:27.756717 run iperf3-srv_10.42.42.10(pid=20413): Launched 12:15:27.873791 tst cs_paging_gprs_active.py:38: start network... 12:15:28.079659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:28.554705 run create_hlr_db(pid=20414): Launched 12:15:28.672424 bus /gobi_6: Setting Powered False 12:15:29.736838 run create_hlr_db(pid=20414): Terminated: ok {rc=0} 12:15:30.175944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20416): Launched 12:15:30.482610 run osmo-hlr_10.42.42.2(pid=20417): Launched 12:15:30.600732 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:31.182158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20419): Launched 12:15:31.509695 run osmo-stp_10.42.42.5(pid=20420): Launched 12:15:31.687454 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:32.414352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20422): Launched 12:15:32.539171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:32.816327 run patchelf(pid=20423): Launched 12:15:33.001160 run osmo-stp_10.42.42.5(pid=20420): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20420)] 12:15:33.139551 run osmo-stp_10.42.42.5(pid=20420): stdout: | (launched: 2022-12-14_12:15:31.448263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:33.280105 run osmo-stp_10.42.42.5(pid=20420): stderr: | [0;m[38;5;43m20221214121531760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121531760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121531760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121531762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121531763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121531763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121531764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:33.420344 run osmo-stp_10.42.42.5(pid=20420): stdout: | (launched: 2022-12-14_12:15:31.448263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:33.554518 run osmo-stp_10.42.42.5(pid=20420): stderr: | [0;m[38;5;43m20221214121531760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121531760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121531760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121531762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121531763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121531763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121531764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:33.713622 run patchelf(pid=20423): Terminating (SIGINT) 12:15:33.897511 run patchelf(pid=20423): Terminated: ok {rc=0} 12:15:34.030091 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20420): Process ended prematurely: osmo-stp_10.42.42.5(pid=20420) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20420)] [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:15:34.040474 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:15:34.069628 run osmo-hlr_10.42.42.2(pid=20417): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20417)] 12:15:34.120116 run osmo-hlr_10.42.42.2(pid=20417): stdout: | (launched: 2022-12-14_12:15:30.425739) 12:15:34.172038 run osmo-hlr_10.42.42.2(pid=20417): stderr: | [0;m[1;31m20221214121530605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121530605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121530605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121530605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121530605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121530606 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121530618 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121530626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121530626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121530626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:34.224470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20410): Terminating (SIGTERM) 12:15:34.266627 run iperf3-srv_10.42.42.10(pid=20411): Terminating (SIGTERM) 12:15:34.310446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20412): Terminating (SIGTERM) 12:15:34.352702 run iperf3-srv_10.42.42.10(pid=20413): Terminating (SIGTERM) 12:15:34.394530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20416): Terminating (SIGTERM) 12:15:34.436404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20419): Terminating (SIGTERM) 12:15:34.478361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20422): Terminating (SIGTERM) 12:15:34.520479 --- ParallelTerminationStrategy: PID 20410 died... 12:15:34.540550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20410): Terminated: ok {rc=0} 12:15:34.587037 --- ParallelTerminationStrategy: PID 20411 died... 12:15:34.606721 run iperf3-srv_10.42.42.10(pid=20411): Terminated {rc=256} 12:15:34.652694 --- ParallelTerminationStrategy: PID 20412 died... 12:15:34.672609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20412): Terminated: ok {rc=0} 12:15:34.718726 --- ParallelTerminationStrategy: PID 20413 died... 12:15:34.738380 run iperf3-srv_10.42.42.10(pid=20413): Terminated {rc=256} 12:15:34.784438 --- ParallelTerminationStrategy: PID 20416 died... 12:15:34.804077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20416): Terminated: ok {rc=0} 12:15:34.850170 --- ParallelTerminationStrategy: PID 20419 died... 12:15:34.870269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20419): Terminated: ok {rc=0} 12:15:34.916376 --- ParallelTerminationStrategy: PID 20422 died... 12:15:34.936124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20422): Terminated: ok {rc=0} 12:15:35.023986 bus /gobi_0: Setting Powered False 12:15:36.123694 bus /gobi_0: Setting Powered False 12:15:37.240323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:15:38.390164 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:38.402302 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:15:38.454801 tst iperf3.py: using LAC 40831 12:15:38.583520 tst iperf3.py: using RAC 31 12:15:38.710915 tst iperf3.py: using CellId 40831 12:15:38.839439 tst iperf3.py: using BVCI 40832 12:15:38.957845 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:38.969202 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:38.980289 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:38.991545 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:39.002722 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:39.013838 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:39.025100 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:39.036154 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:39.047425 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:39.164691 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:15:39.369362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:39.675849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20424): Launched 12:15:39.943383 run iperf3-srv_10.42.42.10(pid=20425): Launched 12:15:40.059664 tst iperf3.py:8: start network... 12:15:40.264515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:40.737646 run create_hlr_db(pid=20426): Launched 12:15:40.855983 bus /gobi_6: Setting Powered False 12:15:41.937571 run create_hlr_db(pid=20426): Terminated: ok {rc=0} 12:15:42.376717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20428): Launched 12:15:42.683569 run osmo-hlr_10.42.42.2(pid=20429): Launched 12:15:42.802225 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:43.330728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20431): Launched 12:15:43.637553 run osmo-stp_10.42.42.5(pid=20432): Launched 12:15:43.753501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:44.280585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20434): Launched 12:15:44.398637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:44.656386 run patchelf(pid=20435): Launched 12:15:44.827444 run osmo-stp_10.42.42.5(pid=20432): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20432)] 12:15:44.956860 run osmo-stp_10.42.42.5(pid=20432): stdout: | (launched: 2022-12-14_12:15:43.580714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:45.087520 run osmo-stp_10.42.42.5(pid=20432): stderr: | [0;m[38;5;43m20221214121543753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121543753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121543754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121543754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121543754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121543755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121543755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:45.219022 run osmo-stp_10.42.42.5(pid=20432): stdout: | (launched: 2022-12-14_12:15:43.580714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:45.343849 run osmo-stp_10.42.42.5(pid=20432): stderr: | [0;m[38;5;43m20221214121543753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121543753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121543754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121543754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121543754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121543755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121543755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:45.492005 run patchelf(pid=20435): Terminating (SIGINT) 12:15:45.663376 run patchelf(pid=20435): Terminated: ok {rc=0} 12:15:45.786868 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20432): Process ended prematurely: osmo-stp_10.42.42.5(pid=20432) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20432)] [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 12:15:45.796359 tst iperf3.py:8: Test FAILED (7.4 sec) 12:15:45.823525 run osmo-hlr_10.42.42.2(pid=20429): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20429)] 12:15:45.884334 run osmo-hlr_10.42.42.2(pid=20429): stdout: | (launched: 2022-12-14_12:15:42.626592) 12:15:45.947350 run osmo-hlr_10.42.42.2(pid=20429): stderr: | [0;m[1;31m20221214121542804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121542804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121542804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121542804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121542804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121542804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121542814 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121542822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121542822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121542822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:46.004370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20424): Terminating (SIGTERM) 12:15:46.048431 run iperf3-srv_10.42.42.10(pid=20425): Terminating (SIGTERM) 12:15:46.095946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20428): Terminating (SIGTERM) 12:15:46.141943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20431): Terminating (SIGTERM) 12:15:46.188448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20434): Terminating (SIGTERM) 12:15:46.236911 --- ParallelTerminationStrategy: PID 20424 died... 12:15:46.258689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20424): Terminated: ok {rc=0} 12:15:46.309881 --- ParallelTerminationStrategy: PID 20425 died... 12:15:46.330876 run iperf3-srv_10.42.42.10(pid=20425): Terminated {rc=256} 12:15:46.380198 --- ParallelTerminationStrategy: PID 20428 died... 12:15:46.402596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20428): Terminated: ok {rc=0} 12:15:46.451418 --- ParallelTerminationStrategy: PID 20431 died... 12:15:46.473024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20431): Terminated: ok {rc=0} 12:15:46.523218 --- ParallelTerminationStrategy: PID 20434 died... 12:15:46.544524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20434): Terminated: ok {rc=0} 12:15:46.639250 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:15:47.783121 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:47.794623 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:15:47.846793 tst iperf3m4.py: using LAC 40832 12:15:47.965974 tst iperf3m4.py: using RAC 32 12:15:48.087048 tst iperf3m4.py: using CellId 40832 12:15:48.207107 tst iperf3m4.py: using BVCI 40833 12:15:48.317806 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:48.328629 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:48.339358 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:48.349985 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:48.360788 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:48.371672 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:48.382674 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:48.393550 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:48.404529 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:48.523316 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:48.643813 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:48.765400 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:48.882531 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:15:49.088841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:49.397154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20436): Launched 12:15:49.665380 run iperf3-srv_10.42.42.10(pid=20437): Launched 12:15:49.782161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:15:49.987156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:50.296211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20438): Launched 12:15:50.563565 run iperf3-srv_10.42.42.10(pid=20439): Launched 12:15:50.677716 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:15:50.881170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:51.188415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20440): Launched 12:15:51.456091 run iperf3-srv_10.42.42.10(pid=20441): Launched 12:15:51.569969 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:15:51.772458 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:52.083099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20446): Launched 12:15:52.351289 run iperf3-srv_10.42.42.10(pid=20447): Launched 12:15:52.467275 tst iperf3m4.py:8: start network... 12:15:52.670624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:53.143051 run create_hlr_db(pid=20448): Launched 12:15:53.261692 bus /gobi_6: Setting Powered False 12:15:54.323031 run create_hlr_db(pid=20448): Terminated: ok {rc=0} 12:15:54.750632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20450): Launched 12:15:55.058309 run osmo-hlr_10.42.42.2(pid=20451): Launched 12:15:55.174930 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:55.701484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20453): Launched 12:15:56.008422 run osmo-stp_10.42.42.5(pid=20454): Launched 12:15:56.126856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:56.652628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20456): Launched 12:15:56.770365 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:57.028129 run patchelf(pid=20457): Launched 12:15:57.199931 run osmo-stp_10.42.42.5(pid=20454): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20454)] 12:15:57.330188 run osmo-stp_10.42.42.5(pid=20454): stdout: | (launched: 2022-12-14_12:15:55.951334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:57.460745 run osmo-stp_10.42.42.5(pid=20454): stderr: | [0;m[38;5;43m20221214121556121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121556121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121556121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121556122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121556122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121556122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121556122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:57.591750 run osmo-stp_10.42.42.5(pid=20454): stdout: | (launched: 2022-12-14_12:15:55.951334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:57.716364 run osmo-stp_10.42.42.5(pid=20454): stderr: | [0;m[38;5;43m20221214121556121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121556121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121556121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121556122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121556122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121556122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121556122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:57.864660 run patchelf(pid=20457): Terminating (SIGINT) 12:15:58.035659 run patchelf(pid=20457): Terminated: ok {rc=0} 12:15:58.159324 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20454): Process ended prematurely: osmo-stp_10.42.42.5(pid=20454) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20454)] [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 12:15:58.168825 tst iperf3m4.py:8: Test FAILED (10.4 sec) 12:15:58.196438 run osmo-hlr_10.42.42.2(pid=20451): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20451)] 12:15:58.244845 run osmo-hlr_10.42.42.2(pid=20451): stdout: | (launched: 2022-12-14_12:15:55.001256) 12:15:58.294675 run osmo-hlr_10.42.42.2(pid=20451): stderr: | [0;m[1;31m20221214121555176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121555176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121555176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121555176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121555176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121555176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121555188 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121555197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121555197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121555197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:58.344571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20436): Terminating (SIGTERM) 12:15:58.384813 run iperf3-srv_10.42.42.10(pid=20437): Terminating (SIGTERM) 12:15:58.424789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20438): Terminating (SIGTERM) 12:15:58.465172 run iperf3-srv_10.42.42.10(pid=20439): Terminating (SIGTERM) 12:15:58.505227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20440): Terminating (SIGTERM) 12:15:58.545273 run iperf3-srv_10.42.42.10(pid=20441): Terminating (SIGTERM) 12:15:58.585808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20446): Terminating (SIGTERM) 12:15:58.626714 run iperf3-srv_10.42.42.10(pid=20447): Terminating (SIGTERM) 12:15:58.666915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20450): Terminating (SIGTERM) 12:15:58.707129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20453): Terminating (SIGTERM) 12:15:58.747262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20456): Terminating (SIGTERM) 12:15:58.788651 --- ParallelTerminationStrategy: PID 20436 died... 12:15:58.808669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20436): Terminated: ok {rc=0} 12:15:58.853714 --- ParallelTerminationStrategy: PID 20437 died... 12:15:58.872758 run iperf3-srv_10.42.42.10(pid=20437): Terminated {rc=256} 12:15:58.917463 --- ParallelTerminationStrategy: PID 20438 died... 12:15:58.936589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20438): Terminated: ok {rc=0} 12:15:58.981102 --- ParallelTerminationStrategy: PID 20439 died... 12:15:59.000207 run iperf3-srv_10.42.42.10(pid=20439): Terminated {rc=256} 12:15:59.044716 --- ParallelTerminationStrategy: PID 20440 died... 12:15:59.063840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20440): Terminated: ok {rc=0} 12:15:59.108360 --- ParallelTerminationStrategy: PID 20441 died... 12:15:59.127463 run iperf3-srv_10.42.42.10(pid=20441): Terminated {rc=256} 12:15:59.172110 --- ParallelTerminationStrategy: PID 20446 died... 12:15:59.191266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20446): Terminated: ok {rc=0} 12:15:59.235880 --- ParallelTerminationStrategy: PID 20447 died... 12:15:59.255071 run iperf3-srv_10.42.42.10(pid=20447): Terminated {rc=256} 12:15:59.299577 --- ParallelTerminationStrategy: PID 20450 died... 12:15:59.318770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20450): Terminated: ok {rc=0} 12:15:59.362965 --- ParallelTerminationStrategy: PID 20453 died... 12:15:59.381898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20453): Terminated: ok {rc=0} 12:15:59.426294 --- ParallelTerminationStrategy: PID 20456 died... 12:15:59.445467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20456): Terminated: ok {rc=0} 12:15:59.530112 bus /gobi_4: Setting Powered False 12:16:00.629333 bus /gobi_4: Setting Powered False 12:16:01.776299 bus /gobi_1: Setting Powered False 12:16:02.889107 bus /gobi_1: Setting Powered False 12:16:04.008502 bus /gobi_0: Setting Powered False 12:16:05.107790 bus /gobi_0: Setting Powered False 12:16:06.226246 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 12:16:07.330684 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:07.342152 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:16:07.393035 tst ping.py: using LAC 40833 12:16:07.519206 tst ping.py: using RAC 33 12:16:07.646143 tst ping.py: using CellId 40833 12:16:07.771407 tst ping.py: using BVCI 40834 12:16:07.888027 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:07.899341 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:07.910506 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:07.921617 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:07.932787 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:07.943859 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:07.955132 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:07.966263 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:16:08.086594 tst ping.py:19: start network... 12:16:08.302605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:08.797405 run create_hlr_db(pid=20458): Launched 12:16:08.928003 bus /gobi_6: Setting Powered False 12:16:09.991980 run create_hlr_db(pid=20458): Terminated: ok {rc=0} 12:16:10.422669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20460): Launched 12:16:10.722378 run osmo-hlr_10.42.42.2(pid=20461): Launched 12:16:10.836010 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:11.358065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20463): Launched 12:16:11.656369 run osmo-stp_10.42.42.5(pid=20464): Launched 12:16:11.769696 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:12.290237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20466): Launched 12:16:12.412326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:12.683971 run patchelf(pid=20467): Launched 12:16:12.862921 run osmo-stp_10.42.42.5(pid=20464): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20464)] 12:16:12.999363 run osmo-stp_10.42.42.5(pid=20464): stdout: | (launched: 2022-12-14_12:16:11.600767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:13.136932 run osmo-stp_10.42.42.5(pid=20464): stderr: | [0;m[38;5;43m20221214121611770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121611770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121611770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121611771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121611771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121611771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121611771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:13.274498 run osmo-stp_10.42.42.5(pid=20464): stdout: | (launched: 2022-12-14_12:16:11.600767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:13.404910 run osmo-stp_10.42.42.5(pid=20464): stderr: | [0;m[38;5;43m20221214121611770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121611770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121611770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121611771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121611771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121611771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121611771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:13.559928 run patchelf(pid=20467): Terminating (SIGINT) 12:16:13.739971 run patchelf(pid=20467): Terminated: ok {rc=0} 12:16:13.869005 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20464): Process ended prematurely: osmo-stp_10.42.42.5(pid=20464) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20464)] [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 12:16:13.879178 tst ping.py:22: Test FAILED (6.5 sec) 12:16:13.907245 run osmo-hlr_10.42.42.2(pid=20461): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20461)] 12:16:13.957294 run osmo-hlr_10.42.42.2(pid=20461): stdout: | (launched: 2022-12-14_12:16:10.666358) 12:16:14.008747 run osmo-hlr_10.42.42.2(pid=20461): stderr: | [0;m[1;31m20221214121610845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121610845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121610845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121610845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121610845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121610845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121610856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121610866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121610866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121610866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:14.060617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20460): Terminating (SIGTERM) 12:16:14.102369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20463): Terminating (SIGTERM) 12:16:14.144655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20466): Terminating (SIGTERM) 12:16:14.187542 --- ParallelTerminationStrategy: PID 20460 died... 12:16:14.207635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20460): Terminated: ok {rc=0} 12:16:14.254515 --- ParallelTerminationStrategy: PID 20463 died... 12:16:14.274407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20463): Terminated: ok {rc=0} 12:16:14.320643 --- ParallelTerminationStrategy: PID 20466 died... 12:16:14.340390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20466): Terminated: ok {rc=0} 12:16:14.427705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:16:15.514648 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:15.526739 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:16:15.580206 tst ping_idle_ping.py: using LAC 40834 12:16:15.707840 tst ping_idle_ping.py: using RAC 34 12:16:15.836209 tst ping_idle_ping.py: using CellId 40834 12:16:15.984337 tst ping_idle_ping.py: using BVCI 40835 12:16:16.118417 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:16.130994 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:16.143200 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:16.155509 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:16.167919 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:16.180184 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:16.192772 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:16.204685 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:16:16.331697 tst ping_idle_ping.py:24: start network... 12:16:16.616549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:17.112084 run create_hlr_db(pid=20468): Launched 12:16:17.264372 bus /gobi_6: Setting Powered False 12:16:18.325740 run create_hlr_db(pid=20468): Terminated: ok {rc=0} 12:16:18.768494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20470): Launched 12:16:19.091502 run osmo-hlr_10.42.42.2(pid=20471): Launched 12:16:19.215242 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:19.773633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20473): Launched 12:16:20.098386 run osmo-stp_10.42.42.5(pid=20474): Launched 12:16:20.221485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:20.778276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20476): Launched 12:16:20.903595 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:21.176528 run patchelf(pid=20477): Launched 12:16:21.357176 run osmo-stp_10.42.42.5(pid=20474): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20474)] 12:16:21.493669 run osmo-stp_10.42.42.5(pid=20474): stdout: | (launched: 2022-12-14_12:16:20.038446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:21.631831 run osmo-stp_10.42.42.5(pid=20474): stderr: | [0;m[38;5;43m20221214121620233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121620234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121620234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121620234 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121620235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121620235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121620235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:21.770011 run osmo-stp_10.42.42.5(pid=20474): stdout: | (launched: 2022-12-14_12:16:20.038446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:21.902296 run osmo-stp_10.42.42.5(pid=20474): stderr: | [0;m[38;5;43m20221214121620233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121620234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121620234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121620234 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121620235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121620235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121620235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:22.058529 run patchelf(pid=20477): Terminating (SIGINT) 12:16:22.238948 run patchelf(pid=20477): Terminated: ok {rc=0} 12:16:22.369200 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20474): Process ended prematurely: osmo-stp_10.42.42.5(pid=20474) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20474)] [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 12:16:22.379010 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 12:16:22.407212 run osmo-hlr_10.42.42.2(pid=20471): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20471)] 12:16:22.457424 run osmo-hlr_10.42.42.2(pid=20471): stdout: | (launched: 2022-12-14_12:16:19.031891) 12:16:22.509743 run osmo-hlr_10.42.42.2(pid=20471): stderr: | [0;m[1;31m20221214121619229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121619229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121619229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121619229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121619229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121619230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121619242 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121619251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121619251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121619251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:22.562733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20470): Terminating (SIGTERM) 12:16:22.604760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20473): Terminating (SIGTERM) 12:16:22.646851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20476): Terminating (SIGTERM) 12:16:22.689808 --- ParallelTerminationStrategy: PID 20470 died... 12:16:22.710394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20470): Terminated: ok {rc=0} 12:16:22.757285 --- ParallelTerminationStrategy: PID 20473 died... 12:16:22.777406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20473): Terminated: ok {rc=0} 12:16:22.824213 --- ParallelTerminationStrategy: PID 20476 died... 12:16:22.844436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20476): Terminated: ok {rc=0} 12:16:22.933436 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:16:24.244534 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:16:24.251203 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:16:24.284923 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:16:24.326444 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:16:24.418388 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:16:24.453275 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:16:24.493618 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:16:25.085498 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:16:25.139153 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:25.150636 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:16:25.228122 tst cs_paging_gprs_active.py: using LAC 40835 12:16:25.357249 tst cs_paging_gprs_active.py: using RAC 35 12:16:25.484446 tst cs_paging_gprs_active.py: using CellId 40835 12:16:25.617335 tst cs_paging_gprs_active.py: using BVCI 40836 12:16:25.737436 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:25.748777 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:25.759974 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:25.771106 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:25.782782 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:25.794522 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:25.806353 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:25.818004 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:25.830012 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:25.955706 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:26.077525 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:16:26.299417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:26.630514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20481): Launched 12:16:26.916706 run iperf3-srv_10.42.42.10(pid=20482): Launched 12:16:27.040722 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:16:27.260662 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:27.591135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20483): Launched 12:16:27.876843 run iperf3-srv_10.42.42.10(pid=20484): Launched 12:16:28.002052 tst cs_paging_gprs_active.py:38: start network... 12:16:28.222213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:28.730661 run create_hlr_db(pid=20485): Launched 12:16:28.864389 bus /gobi_6: Setting Powered False 12:16:29.929364 run create_hlr_db(pid=20485): Terminated: ok {rc=0} 12:16:30.366793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20487): Launched 12:16:30.675086 run osmo-hlr_10.42.42.2(pid=20488): Launched 12:16:30.793917 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:31.510053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20490): Launched 12:16:31.854376 run osmo-stp_10.42.42.5(pid=20491): Launched 12:16:32.054550 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:32.675071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20493): Launched 12:16:32.800133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:33.085600 run patchelf(pid=20494): Launched 12:16:33.269435 run osmo-stp_10.42.42.5(pid=20491): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20491)] 12:16:33.407850 run osmo-stp_10.42.42.5(pid=20491): stdout: | (launched: 2022-12-14_12:16:31.794092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:33.548231 run osmo-stp_10.42.42.5(pid=20491): stderr: | [0;m[38;5;43m20221214121632137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121632138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121632138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121632138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121632139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121632139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121632139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:33.688109 run osmo-stp_10.42.42.5(pid=20491): stdout: | (launched: 2022-12-14_12:16:31.794092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:33.822604 run osmo-stp_10.42.42.5(pid=20491): stderr: | [0;m[38;5;43m20221214121632137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121632138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121632138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121632138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121632139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121632139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121632139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:33.982289 run patchelf(pid=20494): Terminating (SIGINT) 12:16:34.166479 run patchelf(pid=20494): Terminated: ok {rc=0} 12:16:34.298942 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20491): Process ended prematurely: osmo-stp_10.42.42.5(pid=20491) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20491)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:16:34.309218 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 12:16:34.337856 run osmo-hlr_10.42.42.2(pid=20488): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20488)] 12:16:34.388180 run osmo-hlr_10.42.42.2(pid=20488): stdout: | (launched: 2022-12-14_12:16:30.618159) 12:16:34.440344 run osmo-hlr_10.42.42.2(pid=20488): stderr: | [0;m[1;31m20221214121630797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121630797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121630797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121630797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121630797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121630797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121630809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121630820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121630820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121630820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:34.492479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20481): Terminating (SIGTERM) 12:16:34.534457 run iperf3-srv_10.42.42.10(pid=20482): Terminating (SIGTERM) 12:16:34.576826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20483): Terminating (SIGTERM) 12:16:34.618812 run iperf3-srv_10.42.42.10(pid=20484): Terminating (SIGTERM) 12:16:34.661138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20487): Terminating (SIGTERM) 12:16:34.702816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20490): Terminating (SIGTERM) 12:16:34.744419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20493): Terminating (SIGTERM) 12:16:34.786356 --- ParallelTerminationStrategy: PID 20481 died... 12:16:34.806402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20481): Terminated: ok {rc=0} 12:16:34.852229 --- ParallelTerminationStrategy: PID 20482 died... 12:16:34.871673 run iperf3-srv_10.42.42.10(pid=20482): Terminated {rc=256} 12:16:34.917861 --- ParallelTerminationStrategy: PID 20483 died... 12:16:34.937441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20483): Terminated: ok {rc=0} 12:16:34.983293 --- ParallelTerminationStrategy: PID 20484 died... 12:16:35.002990 run iperf3-srv_10.42.42.10(pid=20484): Terminated {rc=256} 12:16:35.048607 --- ParallelTerminationStrategy: PID 20487 died... 12:16:35.068216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20487): Terminated: ok {rc=0} 12:16:35.113829 --- ParallelTerminationStrategy: PID 20490 died... 12:16:35.133399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20490): Terminated: ok {rc=0} 12:16:35.179153 --- ParallelTerminationStrategy: PID 20493 died... 12:16:35.198991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20493): Terminated: ok {rc=0} 12:16:35.285849 bus /gobi_0: Setting Powered False 12:16:36.385371 bus /gobi_0: Setting Powered False 12:16:37.503796 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:16:38.650186 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:38.661656 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:16:38.732833 tst iperf3.py: using LAC 40836 12:16:38.852790 tst iperf3.py: using RAC 36 12:16:38.973819 tst iperf3.py: using CellId 40836 12:16:39.094167 tst iperf3.py: using BVCI 40837 12:16:39.206621 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:39.217516 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:39.228206 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:39.238857 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:39.249839 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:39.260776 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:39.271836 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:39.282695 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:39.293817 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:39.410492 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:16:39.615804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:39.924439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20495): Launched 12:16:40.192734 run iperf3-srv_10.42.42.10(pid=20496): Launched 12:16:40.307410 tst iperf3.py:8: start network... 12:16:40.512846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:40.987117 run create_hlr_db(pid=20497): Launched 12:16:41.105793 bus /gobi_6: Setting Powered False 12:16:42.166896 run create_hlr_db(pid=20497): Terminated: ok {rc=0} 12:16:42.615823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20499): Launched 12:16:42.945192 run osmo-hlr_10.42.42.2(pid=20500): Launched 12:16:43.070964 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:43.635070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20502): Launched 12:16:43.964095 run osmo-stp_10.42.42.5(pid=20503): Launched 12:16:44.090485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:44.656403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20505): Launched 12:16:44.782584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:45.060194 run patchelf(pid=20506): Launched 12:16:45.243734 run osmo-stp_10.42.42.5(pid=20503): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20503)] 12:16:45.382700 run osmo-stp_10.42.42.5(pid=20503): stdout: | (launched: 2022-12-14_12:16:43.903218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:45.523303 run osmo-stp_10.42.42.5(pid=20503): stderr: | [0;m[38;5;43m20221214121644100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121644100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121644100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121644101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121644101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121644101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121644101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:45.663879 run osmo-stp_10.42.42.5(pid=20503): stdout: | (launched: 2022-12-14_12:16:43.903218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:45.798027 run osmo-stp_10.42.42.5(pid=20503): stderr: | [0;m[38;5;43m20221214121644100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121644100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121644100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121644101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121644101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121644101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121644101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:45.965697 run patchelf(pid=20506): Terminating (SIGINT) 12:16:46.144923 run patchelf(pid=20506): Terminated: ok {rc=0} 12:16:46.273809 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20503): Process ended prematurely: osmo-stp_10.42.42.5(pid=20503) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20503)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 12:16:46.284473 tst iperf3.py:8: Test FAILED (7.7 sec) 12:16:46.313566 run osmo-hlr_10.42.42.2(pid=20500): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20500)] 12:16:46.366757 run osmo-hlr_10.42.42.2(pid=20500): stdout: | (launched: 2022-12-14_12:16:42.884244) 12:16:46.420318 run osmo-hlr_10.42.42.2(pid=20500): stderr: | [0;m[1;31m20221214121643088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121643088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121643088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121643088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121643088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121643088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121643099 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121643108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121643108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121643108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:46.473605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20495): Terminating (SIGTERM) 12:16:46.515015 run iperf3-srv_10.42.42.10(pid=20496): Terminating (SIGTERM) 12:16:46.558936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20499): Terminating (SIGTERM) 12:16:46.603864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20502): Terminating (SIGTERM) 12:16:46.647920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20505): Terminating (SIGTERM) 12:16:46.693827 --- ParallelTerminationStrategy: PID 20495 died... 12:16:46.715125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20495): Terminated: ok {rc=0} 12:16:46.763893 --- ParallelTerminationStrategy: PID 20496 died... 12:16:46.784793 run iperf3-srv_10.42.42.10(pid=20496): Terminated {rc=256} 12:16:46.832883 --- ParallelTerminationStrategy: PID 20499 died... 12:16:46.853837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20499): Terminated: ok {rc=0} 12:16:46.900820 --- ParallelTerminationStrategy: PID 20502 died... 12:16:46.921489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20502): Terminated: ok {rc=0} 12:16:46.968645 --- ParallelTerminationStrategy: PID 20505 died... 12:16:46.989965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20505): Terminated: ok {rc=0} 12:16:47.081878 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:16:48.235974 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:48.248132 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:16:48.325403 tst iperf3m4.py: using LAC 40837 12:16:48.447487 tst iperf3m4.py: using RAC 37 12:16:48.567548 tst iperf3m4.py: using CellId 40837 12:16:48.686253 tst iperf3m4.py: using BVCI 40838 12:16:48.799318 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:48.810539 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:48.821521 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:48.832463 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:48.844131 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:48.855799 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:48.867647 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:48.879466 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:48.891393 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:49.017102 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:49.140380 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:49.259605 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:49.380560 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:16:49.601512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:49.931268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20507): Launched 12:16:50.220200 run iperf3-srv_10.42.42.10(pid=20508): Launched 12:16:50.343013 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:16:50.563952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:50.893136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20509): Launched 12:16:51.178727 run iperf3-srv_10.42.42.10(pid=20510): Launched 12:16:51.302911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:16:51.522333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:51.850331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20511): Launched 12:16:52.137563 run iperf3-srv_10.42.42.10(pid=20512): Launched 12:16:52.261209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:16:52.480346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:52.808882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20513): Launched 12:16:53.095881 run iperf3-srv_10.42.42.10(pid=20514): Launched 12:16:53.219201 tst iperf3m4.py:8: start network... 12:16:53.438686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:53.947341 run create_hlr_db(pid=20515): Launched 12:16:54.080195 bus /gobi_6: Setting Powered False 12:16:55.144123 run create_hlr_db(pid=20515): Terminated: ok {rc=0} 12:16:55.582200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20517): Launched 12:16:55.887614 run osmo-hlr_10.42.42.2(pid=20518): Launched 12:16:56.004396 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:56.546053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20520): Launched 12:16:56.852173 run osmo-stp_10.42.42.5(pid=20521): Launched 12:16:56.969141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:57.494561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20523): Launched 12:16:57.613372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:57.871874 run patchelf(pid=20524): Launched 12:16:58.042044 run osmo-stp_10.42.42.5(pid=20521): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20521)] 12:16:58.171876 run osmo-stp_10.42.42.5(pid=20521): stdout: | (launched: 2022-12-14_12:16:56.794756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:58.302991 run osmo-stp_10.42.42.5(pid=20521): stderr: | [0;m[38;5;43m20221214121656964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121656965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121656965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121656965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121656966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121656966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121656966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:58.433856 run osmo-stp_10.42.42.5(pid=20521): stdout: | (launched: 2022-12-14_12:16:56.794756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:58.558872 run osmo-stp_10.42.42.5(pid=20521): stderr: | [0;m[38;5;43m20221214121656964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121656965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121656965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121656965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121656966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121656966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121656966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:58.707658 run patchelf(pid=20524): Terminating (SIGINT) 12:16:58.879117 run patchelf(pid=20524): Terminated: ok {rc=0} 12:16:59.002608 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20521): Process ended prematurely: osmo-stp_10.42.42.5(pid=20521) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20521)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:16:59.012233 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:16:59.039967 run osmo-hlr_10.42.42.2(pid=20518): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20518)] 12:16:59.088435 run osmo-hlr_10.42.42.2(pid=20518): stdout: | (launched: 2022-12-14_12:16:55.830810) 12:16:59.139461 run osmo-hlr_10.42.42.2(pid=20518): stderr: | [0;m[1;31m20221214121656006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121656006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121656006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121656006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121656006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121656006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121656019 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121656029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121656029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121656029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:59.189720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20507): Terminating (SIGTERM) 12:16:59.230366 run iperf3-srv_10.42.42.10(pid=20508): Terminating (SIGTERM) 12:16:59.270895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20509): Terminating (SIGTERM) 12:16:59.311598 run iperf3-srv_10.42.42.10(pid=20510): Terminating (SIGTERM) 12:16:59.352751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20511): Terminating (SIGTERM) 12:16:59.394116 run iperf3-srv_10.42.42.10(pid=20512): Terminating (SIGTERM) 12:16:59.435148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20513): Terminating (SIGTERM) 12:16:59.475674 run iperf3-srv_10.42.42.10(pid=20514): Terminating (SIGTERM) 12:16:59.516389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20517): Terminating (SIGTERM) 12:16:59.557082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20520): Terminating (SIGTERM) 12:16:59.597768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20523): Terminating (SIGTERM) 12:16:59.639053 --- ParallelTerminationStrategy: PID 20507 died... 12:16:59.659154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20507): Terminated: ok {rc=0} 12:16:59.703744 --- ParallelTerminationStrategy: PID 20508 died... 12:16:59.722954 run iperf3-srv_10.42.42.10(pid=20508): Terminated {rc=256} 12:16:59.767407 --- ParallelTerminationStrategy: PID 20509 died... 12:16:59.786622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20509): Terminated: ok {rc=0} 12:16:59.831180 --- ParallelTerminationStrategy: PID 20510 died... 12:16:59.850329 run iperf3-srv_10.42.42.10(pid=20510): Terminated {rc=256} 12:16:59.894825 --- ParallelTerminationStrategy: PID 20511 died... 12:16:59.914500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20511): Terminated: ok {rc=0} 12:16:59.959090 --- ParallelTerminationStrategy: PID 20512 died... 12:16:59.978226 run iperf3-srv_10.42.42.10(pid=20512): Terminated {rc=256} 12:17:00.022734 --- ParallelTerminationStrategy: PID 20513 died... 12:17:00.042096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20513): Terminated: ok {rc=0} 12:17:00.086654 --- ParallelTerminationStrategy: PID 20514 died... 12:17:00.105973 run iperf3-srv_10.42.42.10(pid=20514): Terminated {rc=256} 12:17:00.150355 --- ParallelTerminationStrategy: PID 20517 died... 12:17:00.169584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20517): Terminated: ok {rc=0} 12:17:00.214185 --- ParallelTerminationStrategy: PID 20520 died... 12:17:00.233344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20520): Terminated: ok {rc=0} 12:17:00.277743 --- ParallelTerminationStrategy: PID 20523 died... 12:17:00.297014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20523): Terminated: ok {rc=0} 12:17:00.381660 bus /gobi_4: Setting Powered False 12:17:01.479084 bus /gobi_4: Setting Powered False 12:17:02.598886 bus /gobi_1: Setting Powered False 12:17:03.699686 bus /gobi_1: Setting Powered False 12:17:04.816343 bus /gobi_0: Setting Powered False 12:17:05.915166 bus /gobi_0: Setting Powered False 12:17:07.032518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:17:08.136415 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:08.148390 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:17:08.218715 tst ping.py: using LAC 40838 12:17:08.336549 tst ping.py: using RAC 38 12:17:08.452866 tst ping.py: using CellId 40838 12:17:08.570081 tst ping.py: using BVCI 40839 12:17:08.679496 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:08.690644 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:08.701423 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:08.711975 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:08.722892 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:08.733998 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:08.744915 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:08.755872 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:17:08.877294 tst ping.py:19: start network... 12:17:09.094700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:09.589371 run create_hlr_db(pid=20528): Launched 12:17:09.720739 bus /gobi_6: Setting Powered False 12:17:10.784628 run create_hlr_db(pid=20528): Terminated: ok {rc=0} 12:17:11.215118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20530): Launched 12:17:11.516702 run osmo-hlr_10.42.42.2(pid=20531): Launched 12:17:11.631104 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:12.150034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20533): Launched 12:17:12.450190 run osmo-stp_10.42.42.5(pid=20534): Launched 12:17:12.563516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:13.080586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20536): Launched 12:17:13.197401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:13.451117 run patchelf(pid=20537): Launched 12:17:13.619976 run osmo-stp_10.42.42.5(pid=20534): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20534)] 12:17:13.747371 run osmo-stp_10.42.42.5(pid=20534): stdout: | (launched: 2022-12-14_12:17:12.394160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:13.876176 run osmo-stp_10.42.42.5(pid=20534): stderr: | [0;m[38;5;43m20221214121712563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121712563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121712563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121712564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121712564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121712564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121712564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:14.005691 run osmo-stp_10.42.42.5(pid=20534): stdout: | (launched: 2022-12-14_12:17:12.394160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:14.128449 run osmo-stp_10.42.42.5(pid=20534): stderr: | [0;m[38;5;43m20221214121712563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121712563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121712563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121712564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121712564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121712564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121712564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:14.273751 run patchelf(pid=20537): Terminating (SIGINT) 12:17:14.442343 run patchelf(pid=20537): Terminated: ok {rc=0} 12:17:14.563510 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20534): Process ended prematurely: osmo-stp_10.42.42.5(pid=20534) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20534)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 12:17:14.572523 tst ping.py:22: Test FAILED (6.4 sec) 12:17:14.599624 run osmo-hlr_10.42.42.2(pid=20531): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20531)] 12:17:14.648483 run osmo-hlr_10.42.42.2(pid=20531): stdout: | (launched: 2022-12-14_12:17:11.460603) 12:17:14.698809 run osmo-hlr_10.42.42.2(pid=20531): stderr: | [0;m[1;31m20221214121711640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121711640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121711640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121711640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121711640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121711640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121711652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121711660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121711661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121711661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:14.750807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20530): Terminating (SIGTERM) 12:17:14.791305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20533): Terminating (SIGTERM) 12:17:14.832300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20536): Terminating (SIGTERM) 12:17:14.873305 --- ParallelTerminationStrategy: PID 20530 died... 12:17:14.892696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20530): Terminated: ok {rc=0} 12:17:14.938191 --- ParallelTerminationStrategy: PID 20533 died... 12:17:14.957430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20533): Terminated: ok {rc=0} 12:17:15.002249 --- ParallelTerminationStrategy: PID 20536 died... 12:17:15.021537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20536): Terminated: ok {rc=0} 12:17:15.106601 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:17:16.192031 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:16.206247 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:17:16.281020 tst ping_idle_ping.py: using LAC 40839 12:17:16.447463 tst ping_idle_ping.py: using RAC 39 12:17:16.573445 tst ping_idle_ping.py: using CellId 40839 12:17:16.724230 tst ping_idle_ping.py: using BVCI 40840 12:17:16.845936 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:16.858368 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:16.870617 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:16.883167 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:16.896178 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:16.909284 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:16.921941 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:16.934693 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:17:17.068396 tst ping_idle_ping.py:24: start network... 12:17:17.313405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:17.815451 run create_hlr_db(pid=20538): Launched 12:17:17.948062 bus /gobi_6: Setting Powered False 12:17:19.012843 run create_hlr_db(pid=20538): Terminated: ok {rc=0} 12:17:19.464713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20540): Launched 12:17:19.785854 run osmo-hlr_10.42.42.2(pid=20541): Launched 12:17:19.909267 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:20.468485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20543): Launched 12:17:20.792508 run osmo-stp_10.42.42.5(pid=20544): Launched 12:17:20.916446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:21.474389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20546): Launched 12:17:21.597773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:21.870807 run patchelf(pid=20547): Launched 12:17:22.051845 run osmo-stp_10.42.42.5(pid=20544): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20544)] 12:17:22.189594 run osmo-stp_10.42.42.5(pid=20544): stdout: | (launched: 2022-12-14_12:17:20.732499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:22.328725 run osmo-stp_10.42.42.5(pid=20544): stderr: | [0;m[38;5;43m20221214121720929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121720929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121720929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121720930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121720930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121720930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121720930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:22.467437 run osmo-stp_10.42.42.5(pid=20544): stdout: | (launched: 2022-12-14_12:17:20.732499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:22.599594 run osmo-stp_10.42.42.5(pid=20544): stderr: | [0;m[38;5;43m20221214121720929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121720929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121720929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121720930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121720930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121720930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121720930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:22.756117 run patchelf(pid=20547): Terminating (SIGINT) 12:17:22.938003 run patchelf(pid=20547): Terminated: ok {rc=0} 12:17:23.067981 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20544): Process ended prematurely: osmo-stp_10.42.42.5(pid=20544) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20544)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:17:23.077662 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 12:17:23.106077 run osmo-hlr_10.42.42.2(pid=20541): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20541)] 12:17:23.156926 run osmo-hlr_10.42.42.2(pid=20541): stdout: | (launched: 2022-12-14_12:17:19.725741) 12:17:23.209200 run osmo-hlr_10.42.42.2(pid=20541): stderr: | [0;m[1;31m20221214121719927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121719927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121719927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121719927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121719927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121719927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121719940 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121719948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121719948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121719948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:23.261628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20540): Terminating (SIGTERM) 12:17:23.304159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20543): Terminating (SIGTERM) 12:17:23.346689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20546): Terminating (SIGTERM) 12:17:23.389572 --- ParallelTerminationStrategy: PID 20540 died... 12:17:23.410101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20540): Terminated: ok {rc=0} 12:17:23.456901 --- ParallelTerminationStrategy: PID 20543 died... 12:17:23.476925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20543): Terminated: ok {rc=0} 12:17:23.523560 --- ParallelTerminationStrategy: PID 20546 died... 12:17:23.543567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20546): Terminated: ok {rc=0} 12:17:23.632294 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:17:24.943035 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:17:24.949856 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:17:24.983956 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:17:25.023843 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:17:25.113245 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:17:25.147259 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:17:25.186945 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:17:25.781929 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:17:25.833937 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:25.844677 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:17:25.915664 tst cs_paging_gprs_active.py: using LAC 40840 12:17:26.047023 tst cs_paging_gprs_active.py: using RAC 40 12:17:26.177714 tst cs_paging_gprs_active.py: using CellId 40840 12:17:26.299627 tst cs_paging_gprs_active.py: using BVCI 40841 12:17:26.420685 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:26.432180 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:26.443502 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:26.454974 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:26.466421 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:26.477626 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:26.488926 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:26.500029 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:26.511267 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:26.629929 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:26.753129 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:17:26.958739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:27.267207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20551): Launched 12:17:27.536215 run iperf3-srv_10.42.42.10(pid=20552): Launched 12:17:27.651596 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:17:27.856503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:28.164840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20553): Launched 12:17:28.437829 run iperf3-srv_10.42.42.10(pid=20554): Launched 12:17:28.565516 tst cs_paging_gprs_active.py:38: start network... 12:17:28.786664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:29.297455 run create_hlr_db(pid=20555): Launched 12:17:29.431001 bus /gobi_6: Setting Powered False 12:17:30.495546 run create_hlr_db(pid=20555): Terminated: ok {rc=0} 12:17:30.969711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Launched 12:17:31.344126 run osmo-hlr_10.42.42.2(pid=20558): Launched 12:17:31.517414 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:32.306555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Launched 12:17:32.648533 run osmo-stp_10.42.42.5(pid=20561): Launched 12:17:32.775077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:33.344262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20563): Launched 12:17:33.462316 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:33.723341 run patchelf(pid=20564): Launched 12:17:33.897545 run osmo-stp_10.42.42.5(pid=20561): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] 12:17:34.027315 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-14_12:17:32.587647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:34.159425 run osmo-stp_10.42.42.5(pid=20561): stderr: | [0;m[38;5;43m20221214121732780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121732780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121732781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121732781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121732782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121732782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121732782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:34.291998 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-14_12:17:32.587647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:34.418115 run osmo-stp_10.42.42.5(pid=20561): stderr: | [0;m[38;5;43m20221214121732780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121732780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121732781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121732781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121732782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121732782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121732782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:34.567287 run patchelf(pid=20564): Terminating (SIGINT) 12:17:34.739285 run patchelf(pid=20564): Terminated: ok {rc=0} 12:17:34.863379 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:17:34.872810 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 12:17:34.902412 run osmo-hlr_10.42.42.2(pid=20558): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20558)] 12:17:34.952601 run osmo-hlr_10.42.42.2(pid=20558): stdout: | (launched: 2022-12-14_12:17:31.258880) 12:17:35.004135 run osmo-hlr_10.42.42.2(pid=20558): stderr: | [0;m[1;31m20221214121731685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121731685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121731685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121731685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121731685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121731685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121731702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121731716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121731718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121731722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:35.057238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20551): Terminating (SIGTERM) 12:17:35.098889 run iperf3-srv_10.42.42.10(pid=20552): Terminating (SIGTERM) 12:17:35.141793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20553): Terminating (SIGTERM) 12:17:35.183361 run iperf3-srv_10.42.42.10(pid=20554): Terminating (SIGTERM) 12:17:35.224788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminating (SIGTERM) 12:17:35.266825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminating (SIGTERM) 12:17:35.308394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20563): Terminating (SIGTERM) 12:17:35.350484 --- ParallelTerminationStrategy: PID 20551 died... 12:17:35.370465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20551): Terminated: ok {rc=0} 12:17:35.416460 --- ParallelTerminationStrategy: PID 20552 died... 12:17:35.435964 run iperf3-srv_10.42.42.10(pid=20552): Terminated {rc=256} 12:17:35.482547 --- ParallelTerminationStrategy: PID 20553 died... 12:17:35.502181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20553): Terminated: ok {rc=0} 12:17:35.548118 --- ParallelTerminationStrategy: PID 20554 died... 12:17:35.567655 run iperf3-srv_10.42.42.10(pid=20554): Terminated {rc=256} 12:17:35.613594 --- ParallelTerminationStrategy: PID 20557 died... 12:17:35.633249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminated: ok {rc=0} 12:17:35.679126 --- ParallelTerminationStrategy: PID 20560 died... 12:17:35.698662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminated: ok {rc=0} 12:17:35.744731 --- ParallelTerminationStrategy: PID 20563 died... 12:17:35.764321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20563): Terminated: ok {rc=0} 12:17:35.852560 bus /gobi_0: Setting Powered False 12:17:36.952336 bus /gobi_0: Setting Powered False 12:17:38.068262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:17:39.215542 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:39.227286 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:17:39.297822 tst iperf3.py: using LAC 40841 12:17:39.420278 tst iperf3.py: using RAC 41 12:17:39.541359 tst iperf3.py: using CellId 40841 12:17:39.660852 tst iperf3.py: using BVCI 40842 12:17:39.771978 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:39.782865 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:39.793658 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:39.804330 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:39.815252 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:39.826292 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:39.837347 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:39.848458 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:39.859697 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:39.981177 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:17:40.185887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:40.493746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20567): Launched 12:17:40.761988 run iperf3-srv_10.42.42.10(pid=20568): Launched 12:17:40.878853 tst iperf3.py:8: start network... 12:17:41.084672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:41.561903 run create_hlr_db(pid=20569): Launched 12:17:41.678855 bus /gobi_6: Setting Powered False 12:17:42.740524 run create_hlr_db(pid=20569): Terminated: ok {rc=0} 12:17:43.169964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20571): Launched 12:17:43.478008 run osmo-hlr_10.42.42.2(pid=20572): Launched 12:17:43.594464 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:44.137477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20574): Launched 12:17:44.445418 run osmo-stp_10.42.42.5(pid=20575): Launched 12:17:44.564273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:45.092878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20577): Launched 12:17:45.210258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:45.468902 run patchelf(pid=20578): Launched 12:17:45.640214 run osmo-stp_10.42.42.5(pid=20575): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20575)] 12:17:45.770183 run osmo-stp_10.42.42.5(pid=20575): stdout: | (launched: 2022-12-14_12:17:44.388103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:45.924874 run osmo-stp_10.42.42.5(pid=20575): stderr: | [0;m[38;5;43m20221214121744559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121744559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121744560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121744560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121744561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121744561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121744561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:46.070480 run osmo-stp_10.42.42.5(pid=20575): stdout: | (launched: 2022-12-14_12:17:44.388103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:46.209614 run osmo-stp_10.42.42.5(pid=20575): stderr: | [0;m[38;5;43m20221214121744559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121744559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121744560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121744560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121744561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121744561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121744561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:46.372140 run patchelf(pid=20578): Terminating (SIGINT) 12:17:46.561301 run patchelf(pid=20578): Terminated: ok {rc=0} 12:17:46.697448 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20575): Process ended prematurely: osmo-stp_10.42.42.5(pid=20575) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20575)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 12:17:46.709116 tst iperf3.py:8: Test FAILED (7.5 sec) 12:17:46.739730 run osmo-hlr_10.42.42.2(pid=20572): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20572)] 12:17:46.791186 run osmo-hlr_10.42.42.2(pid=20572): stdout: | (launched: 2022-12-14_12:17:43.420022) 12:17:46.845622 run osmo-hlr_10.42.42.2(pid=20572): stderr: | [0;m[1;31m20221214121743601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121743601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121743601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121743601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121743601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121743601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121743614 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121743622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121743622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121743622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:46.899506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20567): Terminating (SIGTERM) 12:17:46.944111 run iperf3-srv_10.42.42.10(pid=20568): Terminating (SIGTERM) 12:17:46.991505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20571): Terminating (SIGTERM) 12:17:47.038420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20574): Terminating (SIGTERM) 12:17:47.085378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20577): Terminating (SIGTERM) 12:17:47.132196 --- ParallelTerminationStrategy: PID 20567 died... 12:17:47.152931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20567): Terminated: ok {rc=0} 12:17:47.203266 --- ParallelTerminationStrategy: PID 20568 died... 12:17:47.223684 run iperf3-srv_10.42.42.10(pid=20568): Terminated {rc=256} 12:17:47.271237 --- ParallelTerminationStrategy: PID 20571 died... 12:17:47.291558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20571): Terminated: ok {rc=0} 12:17:47.337947 --- ParallelTerminationStrategy: PID 20574 died... 12:17:47.357707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20574): Terminated: ok {rc=0} 12:17:47.403900 --- ParallelTerminationStrategy: PID 20577 died... 12:17:47.423689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20577): Terminated: ok {rc=0} 12:17:47.510787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:17:48.654793 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:48.666502 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:17:48.737378 tst iperf3m4.py: using LAC 40842 12:17:48.858723 tst iperf3m4.py: using RAC 42 12:17:48.980743 tst iperf3m4.py: using CellId 40842 12:17:49.100041 tst iperf3m4.py: using BVCI 40843 12:17:49.212140 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:49.223254 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:49.234053 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:49.244703 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:49.255662 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:49.266732 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:49.278006 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:49.288787 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:49.299940 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:49.421595 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:49.543158 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:49.663744 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:49.783256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:17:49.989024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:50.297647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20579): Launched 12:17:50.567374 run iperf3-srv_10.42.42.10(pid=20580): Launched 12:17:50.683704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:17:50.888023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:51.196939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20581): Launched 12:17:51.464640 run iperf3-srv_10.42.42.10(pid=20582): Launched 12:17:51.580756 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:17:51.784085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:52.092224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20583): Launched 12:17:52.361619 run iperf3-srv_10.42.42.10(pid=20584): Launched 12:17:52.475472 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:17:52.678702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:52.986891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20585): Launched 12:17:53.255833 run iperf3-srv_10.42.42.10(pid=20586): Launched 12:17:53.371442 tst iperf3m4.py:8: start network... 12:17:53.574642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:54.047835 run create_hlr_db(pid=20587): Launched 12:17:54.165974 bus /gobi_6: Setting Powered False 12:17:55.227092 run create_hlr_db(pid=20587): Terminated: ok {rc=0} 12:17:55.676031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20589): Launched 12:17:56.006194 run osmo-hlr_10.42.42.2(pid=20590): Launched 12:17:56.132306 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:56.697848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20592): Launched 12:17:57.026519 run osmo-stp_10.42.42.5(pid=20593): Launched 12:17:57.153282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:57.718485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20595): Launched 12:17:57.842974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:58.120592 run patchelf(pid=20596): Launched 12:17:58.304025 run osmo-stp_10.42.42.5(pid=20593): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20593)] 12:17:58.442520 run osmo-stp_10.42.42.5(pid=20593): stdout: | (launched: 2022-12-14_12:17:56.965449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:58.583053 run osmo-stp_10.42.42.5(pid=20593): stderr: | [0;m[38;5;43m20221214121757158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121757158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121757158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121757158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121757159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121757159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121757159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:58.722878 run osmo-stp_10.42.42.5(pid=20593): stdout: | (launched: 2022-12-14_12:17:56.965449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:58.856680 run osmo-stp_10.42.42.5(pid=20593): stderr: | [0;m[38;5;43m20221214121757158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121757158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121757158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121757158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121757159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121757159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121757159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:59.015807 run patchelf(pid=20596): Terminating (SIGINT) 12:17:59.199705 run patchelf(pid=20596): Terminated: ok {rc=0} 12:17:59.331656 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20593): Process ended prematurely: osmo-stp_10.42.42.5(pid=20593) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20593)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:17:59.342100 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:17:59.370819 run osmo-hlr_10.42.42.2(pid=20590): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20590)] 12:17:59.421235 run osmo-hlr_10.42.42.2(pid=20590): stdout: | (launched: 2022-12-14_12:17:55.945293) 12:17:59.472893 run osmo-hlr_10.42.42.2(pid=20590): stderr: | [0;m[1;31m20221214121756142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121756142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121756142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121756142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121756142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121756143 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121756203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121756212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121756212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121756212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:59.524761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20579): Terminating (SIGTERM) 12:17:59.566940 run iperf3-srv_10.42.42.10(pid=20580): Terminating (SIGTERM) 12:17:59.609081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20581): Terminating (SIGTERM) 12:17:59.651722 run iperf3-srv_10.42.42.10(pid=20582): Terminating (SIGTERM) 12:17:59.693771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20583): Terminating (SIGTERM) 12:17:59.735779 run iperf3-srv_10.42.42.10(pid=20584): Terminating (SIGTERM) 12:17:59.777753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20585): Terminating (SIGTERM) 12:17:59.819615 run iperf3-srv_10.42.42.10(pid=20586): Terminating (SIGTERM) 12:17:59.861650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20589): Terminating (SIGTERM) 12:17:59.903387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20592): Terminating (SIGTERM) 12:17:59.945701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20595): Terminating (SIGTERM) 12:17:59.988413 --- ParallelTerminationStrategy: PID 20579 died... 12:18:00.008695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20579): Terminated: ok {rc=0} 12:18:00.055467 --- ParallelTerminationStrategy: PID 20580 died... 12:18:00.075376 run iperf3-srv_10.42.42.10(pid=20580): Terminated {rc=256} 12:18:00.122231 --- ParallelTerminationStrategy: PID 20581 died... 12:18:00.142108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20581): Terminated: ok {rc=0} 12:18:00.188336 --- ParallelTerminationStrategy: PID 20582 died... 12:18:00.207860 run iperf3-srv_10.42.42.10(pid=20582): Terminated {rc=256} 12:18:00.254379 --- ParallelTerminationStrategy: PID 20583 died... 12:18:00.274078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20583): Terminated: ok {rc=0} 12:18:00.320400 --- ParallelTerminationStrategy: PID 20584 died... 12:18:00.340353 run iperf3-srv_10.42.42.10(pid=20584): Terminated {rc=256} 12:18:00.386830 --- ParallelTerminationStrategy: PID 20585 died... 12:18:00.406698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20585): Terminated: ok {rc=0} 12:18:00.453295 --- ParallelTerminationStrategy: PID 20586 died... 12:18:00.472851 run iperf3-srv_10.42.42.10(pid=20586): Terminated {rc=256} 12:18:00.519434 --- ParallelTerminationStrategy: PID 20589 died... 12:18:00.539413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20589): Terminated: ok {rc=0} 12:18:00.585888 --- ParallelTerminationStrategy: PID 20592 died... 12:18:00.605835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20592): Terminated: ok {rc=0} 12:18:00.652212 --- ParallelTerminationStrategy: PID 20595 died... 12:18:00.672089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20595): Terminated: ok {rc=0} 12:18:00.760428 bus /gobi_4: Setting Powered False 12:18:01.860069 bus /gobi_4: Setting Powered False 12:18:02.979540 bus /gobi_1: Setting Powered False 12:18:04.079449 bus /gobi_1: Setting Powered False 12:18:05.196060 bus /gobi_0: Setting Powered False 12:18:06.294738 bus /gobi_0: Setting Powered False 12:18:07.414324 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:18:08.520557 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:08.532570 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:18:08.605483 tst ping.py: using LAC 40843 12:18:08.725078 tst ping.py: using RAC 43 12:18:08.845581 tst ping.py: using CellId 40843 12:18:08.962507 tst ping.py: using BVCI 40844 12:18:09.070805 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:09.081777 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:09.092487 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:09.103632 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:09.114659 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:09.125644 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:09.136570 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:09.147623 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:18:09.269281 tst ping.py:19: start network... 12:18:09.487164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:09.987726 run create_hlr_db(pid=20598): Launched 12:18:10.120074 bus /gobi_6: Setting Powered False 12:18:11.184736 run create_hlr_db(pid=20598): Terminated: ok {rc=0} 12:18:11.617876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20600): Launched 12:18:11.922524 run osmo-hlr_10.42.42.2(pid=20601): Launched 12:18:12.037581 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:12.598261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20603): Launched 12:18:12.920171 run osmo-stp_10.42.42.5(pid=20604): Launched 12:18:13.042503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:13.599373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20606): Launched 12:18:13.723378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:13.996708 run patchelf(pid=20607): Launched 12:18:14.175479 run osmo-stp_10.42.42.5(pid=20604): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20604)] 12:18:14.311875 run osmo-stp_10.42.42.5(pid=20604): stdout: | (launched: 2022-12-14_12:18:12.859727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:14.450318 run osmo-stp_10.42.42.5(pid=20604): stderr: | [0;m[38;5;43m20221214121813053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121813053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121813053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121813054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121813056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121813056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121813056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:14.588364 run osmo-stp_10.42.42.5(pid=20604): stdout: | (launched: 2022-12-14_12:18:12.859727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:14.719738 run osmo-stp_10.42.42.5(pid=20604): stderr: | [0;m[38;5;43m20221214121813053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121813053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121813053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121813054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121813056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121813056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121813056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:14.875664 run patchelf(pid=20607): Terminating (SIGINT) 12:18:15.056580 run patchelf(pid=20607): Terminated: ok {rc=0} 12:18:15.186629 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20604): Process ended prematurely: osmo-stp_10.42.42.5(pid=20604) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20604)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 12:18:15.196166 tst ping.py:22: Test FAILED (6.7 sec) 12:18:15.224786 run osmo-hlr_10.42.42.2(pid=20601): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20601)] 12:18:15.275241 run osmo-hlr_10.42.42.2(pid=20601): stdout: | (launched: 2022-12-14_12:18:11.866052) 12:18:15.327356 run osmo-hlr_10.42.42.2(pid=20601): stderr: | [0;m[1;31m20221214121812045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121812045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121812045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121812045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121812045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121812045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121812059 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121812069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121812069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121812069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:15.379922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20600): Terminating (SIGTERM) 12:18:15.422233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20603): Terminating (SIGTERM) 12:18:15.464389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20606): Terminating (SIGTERM) 12:18:15.507478 --- ParallelTerminationStrategy: PID 20600 died... 12:18:15.527798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20600): Terminated: ok {rc=0} 12:18:15.574439 --- ParallelTerminationStrategy: PID 20603 died... 12:18:15.594226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20603): Terminated: ok {rc=0} 12:18:15.640524 --- ParallelTerminationStrategy: PID 20606 died... 12:18:15.660408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20606): Terminated: ok {rc=0} 12:18:15.749031 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:18:16.841977 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:16.860039 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:18:16.955959 tst ping_idle_ping.py: using LAC 40844 12:18:17.090006 tst ping_idle_ping.py: using RAC 44 12:18:17.218801 tst ping_idle_ping.py: using CellId 40844 12:18:17.347158 tst ping_idle_ping.py: using BVCI 40845 12:18:17.464591 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:17.476193 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:17.487664 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:17.499149 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:17.510482 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:17.521914 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:17.533292 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:17.545107 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:18:17.667296 tst ping_idle_ping.py:24: start network... 12:18:17.884825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:18.389655 run create_hlr_db(pid=20608): Launched 12:18:18.521922 bus /gobi_6: Setting Powered False 12:18:19.586115 run create_hlr_db(pid=20608): Terminated: ok {rc=0} 12:18:20.020706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20610): Launched 12:18:20.324265 run osmo-hlr_10.42.42.2(pid=20611): Launched 12:18:20.441815 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:20.976064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20613): Launched 12:18:21.279437 run osmo-stp_10.42.42.5(pid=20614): Launched 12:18:21.396028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:21.916752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20616): Launched 12:18:22.033066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:22.287560 run patchelf(pid=20617): Launched 12:18:22.454929 run osmo-stp_10.42.42.5(pid=20614): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20614)] 12:18:22.583270 run osmo-stp_10.42.42.5(pid=20614): stdout: | (launched: 2022-12-14_12:18:21.222435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:22.712797 run osmo-stp_10.42.42.5(pid=20614): stderr: | [0;m[38;5;43m20221214121821396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121821396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121821396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121821396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121821397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121821397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121821397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:22.842785 run osmo-stp_10.42.42.5(pid=20614): stdout: | (launched: 2022-12-14_12:18:21.222435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:22.966195 run osmo-stp_10.42.42.5(pid=20614): stderr: | [0;m[38;5;43m20221214121821396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121821396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121821396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121821396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121821397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121821397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121821397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:23.112475 run patchelf(pid=20617): Terminating (SIGINT) 12:18:23.281804 run patchelf(pid=20617): Terminated: ok {rc=0} 12:18:23.403736 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20614): Process ended prematurely: osmo-stp_10.42.42.5(pid=20614) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20614)] [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:18:23.412862 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:18:23.439774 run osmo-hlr_10.42.42.2(pid=20611): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20611)] 12:18:23.487963 run osmo-hlr_10.42.42.2(pid=20611): stdout: | (launched: 2022-12-14_12:18:20.268083) 12:18:23.537570 run osmo-hlr_10.42.42.2(pid=20611): stderr: | [0;m[1;31m20221214121820444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121820445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121820445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121820445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121820445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121820445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121820457 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121820465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121820465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121820465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:23.587644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20610): Terminating (SIGTERM) 12:18:23.628193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20613): Terminating (SIGTERM) 12:18:23.669497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20616): Terminating (SIGTERM) 12:18:23.710021 --- ParallelTerminationStrategy: PID 20610 died... 12:18:23.729475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20610): Terminated: ok {rc=0} 12:18:23.773802 --- ParallelTerminationStrategy: PID 20613 died... 12:18:23.792666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20613): Terminated: ok {rc=0} 12:18:23.836777 --- ParallelTerminationStrategy: PID 20616 died... 12:18:23.855859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20616): Terminated: ok {rc=0} 12:18:23.940203 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:18:25.243458 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:25.250052 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:18:25.282414 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:18:25.318058 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:18:25.375246 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:18:25.409126 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:18:25.443520 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:18:25.995798 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:18:26.001253 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:26.012553 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:18:26.081354 tst switch_tch_pdch.py: using LAC 40845 12:18:26.197667 tst switch_tch_pdch.py: using RAC 45 12:18:26.329561 tst switch_tch_pdch.py: using CellId 40845 12:18:26.465914 tst switch_tch_pdch.py: using BVCI 40846 12:18:26.584228 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:26.596020 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:26.607475 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:26.618987 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:26.630479 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:26.641970 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:26.653687 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:26.665256 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:18:26.782617 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:18:26.910234 tst switch_tch_pdch.py:51: start network... 12:18:27.129224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:27.628217 run create_hlr_db(pid=20622): Launched 12:18:27.759725 bus /gobi_6: Setting Powered False 12:18:28.822874 run create_hlr_db(pid=20622): Terminated: ok {rc=0} 12:18:29.273031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20624): Launched 12:18:29.597648 run osmo-hlr_10.42.42.2(pid=20625): Launched 12:18:29.721453 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:30.276586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20627): Launched 12:18:30.599509 run osmo-stp_10.42.42.5(pid=20628): Launched 12:18:30.722779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:31.306842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20630): Launched 12:18:31.452475 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:31.731037 run patchelf(pid=20631): Launched 12:18:31.920522 run osmo-stp_10.42.42.5(pid=20628): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20628)] 12:18:32.052496 run osmo-stp_10.42.42.5(pid=20628): stdout: | (launched: 2022-12-14_12:18:30.539614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:32.188894 run osmo-stp_10.42.42.5(pid=20628): stderr: | [0;m[38;5;43m20221214121830734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121830734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121830734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121830734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121830735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121830735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121830735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:32.323809 run osmo-stp_10.42.42.5(pid=20628): stdout: | (launched: 2022-12-14_12:18:30.539614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:32.455394 run osmo-stp_10.42.42.5(pid=20628): stderr: | [0;m[38;5;43m20221214121830734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121830734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121830734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121830734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121830735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121830735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121830735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:32.611103 run patchelf(pid=20631): Terminating (SIGINT) 12:18:32.791286 run patchelf(pid=20631): Terminated: ok {rc=0} 12:18:32.921371 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20628): Process ended prematurely: osmo-stp_10.42.42.5(pid=20628) [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20628)] [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:18:32.931538 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 12:18:32.960216 run osmo-hlr_10.42.42.2(pid=20625): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20625)] 12:18:33.010696 run osmo-hlr_10.42.42.2(pid=20625): stdout: | (launched: 2022-12-14_12:18:29.537758) 12:18:33.062586 run osmo-hlr_10.42.42.2(pid=20625): stderr: | [0;m[1;31m20221214121829738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121829738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121829738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121829738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121829739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121829739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121829751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121829759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121829759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121829759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:33.114948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20624): Terminating (SIGTERM) 12:18:33.156988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20627): Terminating (SIGTERM) 12:18:33.199694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20630): Terminating (SIGTERM) 12:18:33.242044 --- ParallelTerminationStrategy: PID 20624 died... 12:18:33.262199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20624): Terminated: ok {rc=0} 12:18:33.308601 --- ParallelTerminationStrategy: PID 20627 died... 12:18:33.328306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20627): Terminated: ok {rc=0} 12:18:33.374948 --- ParallelTerminationStrategy: PID 20630 died... 12:18:33.394783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20630): Terminated: ok {rc=0} 12:18:33.483155 bus /gobi_0: Setting Powered False 12:18:34.582643 bus /gobi_0: Setting Powered False 12:18:35.699418 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:18:36.960700 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:36.967305 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:18:37.001092 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:18:37.036810 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:18:37.089864 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:18:37.124172 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:18:37.159681 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:18:37.713188 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:18:37.720696 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:37.733548 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:18:37.804418 tst switch_tch_pdch.py: using LAC 40846 12:18:37.928285 tst switch_tch_pdch.py: using RAC 46 12:18:38.059301 tst switch_tch_pdch.py: using CellId 40846 12:18:38.185757 tst switch_tch_pdch.py: using BVCI 40847 12:18:38.301997 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:38.313510 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:38.324593 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:38.335796 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:38.347058 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:38.358490 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:38.369956 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:38.381327 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:18:38.499129 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:18:38.620256 tst switch_tch_pdch.py:51: start network... 12:18:38.837872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:39.308300 run create_hlr_db(pid=20635): Launched 12:18:39.440577 bus /gobi_6: Setting Powered False 12:18:40.504601 run create_hlr_db(pid=20635): Terminated: ok {rc=0} 12:18:40.909579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20637): Launched 12:18:41.210545 run osmo-hlr_10.42.42.2(pid=20638): Launched 12:18:41.324047 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:41.829545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20640): Launched 12:18:42.130000 run osmo-stp_10.42.42.5(pid=20641): Launched 12:18:42.245109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:42.735530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20643): Launched 12:18:42.851780 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:43.105301 run patchelf(pid=20644): Launched 12:18:43.273919 run osmo-stp_10.42.42.5(pid=20641): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20641)] 12:18:43.401334 run osmo-stp_10.42.42.5(pid=20641): stdout: | (launched: 2022-12-14_12:18:42.073738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:43.530882 run osmo-stp_10.42.42.5(pid=20641): stderr: | [0;m[38;5;43m20221214121842246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121842246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121842247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121842247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121842247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121842247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121842248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:43.660083 run osmo-stp_10.42.42.5(pid=20641): stdout: | (launched: 2022-12-14_12:18:42.073738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:43.782600 run osmo-stp_10.42.42.5(pid=20641): stderr: | [0;m[38;5;43m20221214121842246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121842246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121842247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121842247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121842247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121842247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121842248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:43.927819 run patchelf(pid=20644): Terminating (SIGINT) 12:18:44.097190 run patchelf(pid=20644): Terminated: ok {rc=0} 12:18:44.219938 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20641): Process ended prematurely: osmo-stp_10.42.42.5(pid=20641) [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20641)] [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:18:44.229060 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 12:18:44.255903 run osmo-hlr_10.42.42.2(pid=20638): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20638)] 12:18:44.304291 run osmo-hlr_10.42.42.2(pid=20638): stdout: | (launched: 2022-12-14_12:18:41.154589) 12:18:44.354188 run osmo-hlr_10.42.42.2(pid=20638): stderr: | [0;m[1;31m20221214121841328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121841328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121841328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121841328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121841328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121841329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121841340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121841349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121841349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121841349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:44.404222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20637): Terminating (SIGTERM) 12:18:44.444411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20640): Terminating (SIGTERM) 12:18:44.484449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20643): Terminating (SIGTERM) 12:18:44.524738 --- ParallelTerminationStrategy: PID 20637 died... 12:18:44.544190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20637): Terminated: ok {rc=0} 12:18:44.588318 --- ParallelTerminationStrategy: PID 20640 died... 12:18:44.607364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20640): Terminated: ok {rc=0} 12:18:44.651407 --- ParallelTerminationStrategy: PID 20643 died... 12:18:44.670429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20643): Terminated: ok {rc=0} 12:18:44.756530 bus /gobi_0: Setting Powered False 12:18:45.869152 bus /gobi_0: Setting Powered False 12:18:47.004032 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 12:18:48.260633 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:48.264579 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:18:48.293254 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 12:18:48.299815 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:18:48.351440 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:18:48.380661 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 12:18:48.387545 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:18:48.926394 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 12:18:48.931572 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 12:18:48.942646 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:18:48.986744 tst mo_mt_sms.py: using LAC 40847 12:18:49.105653 tst mo_mt_sms.py: using RAC 47 12:18:49.237019 tst mo_mt_sms.py: using CellId 40847 12:18:49.361838 tst mo_mt_sms.py: using BVCI 40848 12:18:49.477630 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:18:49.595435 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:18:49.709611 tst mo_mt_sms.py:9: start nitb and bts... 12:18:49.912237 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:18:50.525085 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20648): Launched 12:18:50.827412 run osmo-nitb_10.42.42.2(pid=20649): Launched 12:18:50.993567 run osmo-nitb_10.42.42.2(pid=20649): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20649)] 12:18:51.128337 run osmo-nitb_10.42.42.2(pid=20649): stdout: | (launched: 2022-12-14_12:18:50.771392) 12:18:51.264828 run osmo-nitb_10.42.42.2(pid=20649): stderr: | (launched: 2022-12-14_12:18:50.815716) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:18:51.401472 run osmo-nitb_10.42.42.2(pid=20649): stdout: | (launched: 2022-12-14_12:18:50.771392) 12:18:51.532399 run osmo-nitb_10.42.42.2(pid=20649): stderr: | (launched: 2022-12-14_12:18:50.815716) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20649): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20649) [trial-2404↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20649)] 12:18:51.940279 tst osmo-nitb_10.42.42.2(pid=20649): stdout: | (launched: 2022-12-14_12:18:50.771392) 12:18:52.061600 tst osmo-nitb_10.42.42.2(pid=20649): stderr: | (launched: 2022-12-14_12:18:50.815716) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:18:52.204382 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20649): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20649) [trial-2404↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20649)] [trial-2404↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 12:18:52.213001 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 12:18:52.219707 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20648): Terminating (SIGTERM) 12:18:52.429063 --- ParallelTerminationStrategy: PID 20648 died... 12:18:52.449617 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20648): Terminated: ok {rc=0} 12:18:52.536637 bus /sierra_3: Setting Powered False 12:18:53.636474 bus /sierra_3: Setting Powered False 12:18:54.754751 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 12:18:55.947636 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:55.951706 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:18:55.980823 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:18:56.008320 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:18:56.060270 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:18:56.090739 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:18:56.119484 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:18:56.662746 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 12:18:56.668478 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:18:56.679710 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:18:56.723099 tst mo_mt_sms.py: using LAC 40848 12:18:56.839732 tst mo_mt_sms.py: using RAC 48 12:18:56.956884 tst mo_mt_sms.py: using CellId 40848 12:18:57.073731 tst mo_mt_sms.py: using BVCI 40849 12:18:57.190832 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:18:57.202298 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:18:57.213645 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:18:57.224779 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:18:57.236163 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:18:57.247853 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:18:57.364309 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:18:57.484202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:57.984174 run create_hlr_db(pid=20653): Launched 12:18:58.115997 bus /sierra_2: Setting Powered False 12:18:59.180191 run create_hlr_db(pid=20653): Terminated: ok {rc=0} 12:18:59.612410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20655): Launched 12:18:59.913702 run osmo-hlr_10.42.42.2(pid=20656): Launched 12:19:00.028529 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:00.560865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20658): Launched 12:19:00.886754 run osmo-stp_10.42.42.5(pid=20659): Launched 12:19:01.150212 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:01.749510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20661): Launched 12:19:02.073698 run osmo-msc_10.42.42.6(pid=20662): Launched 12:19:02.370705 run osmo-stp_10.42.42.5(pid=20659): ERR: Terminated: ERROR {rc=1} [trial-2404↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20659)] 12:19:02.547584 run osmo-stp_10.42.42.5(pid=20659): stdout: | (launched: 2022-12-14_12:19:00.807514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:02.686703 run osmo-stp_10.42.42.5(pid=20659): stderr: | [0;m[38;5;43m20221214121901050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121901050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121901050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121901051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121901051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121901051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121901051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:02.822094 run osmo-stp_10.42.42.5(pid=20659): stdout: | (launched: 2022-12-14_12:19:00.807514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:02.950391 run osmo-stp_10.42.42.5(pid=20659): stderr: | [0;m[38;5;43m20221214121901050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121901050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121901050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121901051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121901051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121901051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121901051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:03.104129 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20659): Process ended prematurely: osmo-stp_10.42.42.5(pid=20659) [trial-2404↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20659)] [trial-2404↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 12:19:03.113373 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 12:19:03.141501 run osmo-hlr_10.42.42.2(pid=20656): ERR: Terminated: ERROR {rc=237} [trial-2404↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20656)] 12:19:03.192304 run osmo-hlr_10.42.42.2(pid=20656): stdout: | (launched: 2022-12-14_12:18:59.857599) 12:19:03.244943 run osmo-hlr_10.42.42.2(pid=20656): stderr: | [0;m[1;31m20221214121900035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121900035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121900035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121900035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121900035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121900035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121900048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121900056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121900056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121900056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:03.318258 run osmo-msc_10.42.42.6(pid=20662): ERR: Terminated: ERROR {rc=2} [trial-2404↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20662)] 12:19:03.369188 run osmo-msc_10.42.42.6(pid=20662): stdout: | (launched: 2022-12-14_12:19:02.012783) 12:19:03.421657 run osmo-msc_10.42.42.6(pid=20662): stderr: | [0;m[38;5;43m20221214121902458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121902459 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6444912c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121902459 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121902459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121902459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121902459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121902461 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121902461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121902461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121902461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:03.474817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20655): Terminating (SIGTERM) 12:19:03.517163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20658): Terminating (SIGTERM) 12:19:03.559638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20661): Terminating (SIGTERM) 12:19:03.602781 --- ParallelTerminationStrategy: PID 20655 died... 12:19:03.623485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20655): Terminated: ok {rc=0} 12:19:03.670504 --- ParallelTerminationStrategy: PID 20658 died... 12:19:03.690502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20658): Terminated: ok {rc=0} 12:19:03.737408 --- ParallelTerminationStrategy: PID 20661 died... 12:19:03.757459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20661): Terminated: ok {rc=0} 12:19:03.846081 bus /sierra_3: Setting Powered False 12:19:04.946233 bus /sierra_3: Setting Powered False 12:19:06.063488 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 12:19:07.293146 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:07.297255 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:19:07.326871 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 12:19:07.333866 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 12:19:07.370697 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:19:07.400684 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 12:19:07.407728 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 12:19:07.927006 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 12:19:07.933279 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 12:19:07.945313 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:19:07.991110 tst assert_extension.py: using LAC 40849 12:19:08.118978 tst assert_extension.py: using RAC 49 12:19:08.246116 tst assert_extension.py: using CellId 40849 12:19:08.373467 tst assert_extension.py: using BVCI 40850 12:19:08.485607 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 12:19:08.603146 tst assert_extension.py:10: start nitb and bts... 12:19:08.820611 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:19:09.478850 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20667): Launched 12:19:09.801993 run osmo-nitb_10.42.42.2(pid=20668): Launched 12:19:09.981589 run osmo-nitb_10.42.42.2(pid=20668): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20668)] 12:19:10.125344 run osmo-nitb_10.42.42.2(pid=20668): stdout: | (launched: 2022-12-14_12:19:09.741978) 12:19:10.270855 run osmo-nitb_10.42.42.2(pid=20668): stderr: | (launched: 2022-12-14_12:19:09.789778) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:19:10.416166 run osmo-nitb_10.42.42.2(pid=20668): stdout: | (launched: 2022-12-14_12:19:09.741978) 12:19:10.555306 run osmo-nitb_10.42.42.2(pid=20668): stderr: | (launched: 2022-12-14_12:19:09.789778) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20668): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20668) [trial-2404↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20668)] 12:19:10.924279 tst osmo-nitb_10.42.42.2(pid=20668): stdout: | (launched: 2022-12-14_12:19:09.741978) 12:19:11.054217 tst osmo-nitb_10.42.42.2(pid=20668): stderr: | (launched: 2022-12-14_12:19:09.789778) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:19:11.207089 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20668): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20668) [trial-2404↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20668)] [trial-2404↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 12:19:11.216266 tst assert_extension.py:12: Test FAILED (3.3 sec) 12:19:11.223651 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20667): Terminating (SIGTERM) 12:19:11.434348 --- ParallelTerminationStrategy: PID 20667 died... 12:19:11.456411 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20667): Terminated: ok {rc=0} 12:19:11.545669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 12:19:12.718745 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:12.723141 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:19:12.752527 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:19:12.780162 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 12:19:12.816616 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:19:12.846074 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:19:12.872920 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 12:19:13.405264 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 12:19:13.410597 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:19:13.422052 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:19:13.467707 tst assert_extension.py: using LAC 40850 12:19:13.586689 tst assert_extension.py: using RAC 50 12:19:13.712779 tst assert_extension.py: using CellId 40850 12:19:13.838311 tst assert_extension.py: using BVCI 40851 12:19:13.956393 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:19:13.968143 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:19:13.979603 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:19:13.990773 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:19:14.001925 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:19:14.013119 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 12:19:14.130095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:14.596186 run create_hlr_db(pid=20672): Launched 12:19:14.710907 bus /sierra_2: Setting Powered False 12:19:15.770944 run create_hlr_db(pid=20672): Terminated: ok {rc=0} 12:19:16.253658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20674): Launched 12:19:16.565349 run osmo-hlr_10.42.42.2(pid=20675): Launched 12:19:16.794434 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:17.457052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20677): Launched 12:19:17.758617 run osmo-stp_10.42.42.5(pid=20678): Launched 12:19:17.875073 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:18.415229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20680): Launched 12:19:18.715973 run osmo-msc_10.42.42.6(pid=20681): Launched 12:19:18.884685 run osmo-stp_10.42.42.5(pid=20678): ERR: Terminated: ERROR {rc=1} [trial-2404↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20678)] 12:19:19.011934 run osmo-stp_10.42.42.5(pid=20678): stdout: | (launched: 2022-12-14_12:19:17.701817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:19.139267 run osmo-stp_10.42.42.5(pid=20678): stderr: | [0;m[38;5;43m20221214121917874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121917874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121917875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121917875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121917876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121917876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121917876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:19.263757 run osmo-stp_10.42.42.5(pid=20678): stdout: | (launched: 2022-12-14_12:19:17.701817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:19.382693 run osmo-stp_10.42.42.5(pid=20678): stderr: | [0;m[38;5;43m20221214121917874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121917874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121917875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121917875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121917876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121917876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121917876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:19.524714 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20678): Process ended prematurely: osmo-stp_10.42.42.5(pid=20678) [trial-2404↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20678)] [trial-2404↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 12:19:19.532935 tst assert_extension.py:17: Test FAILED (6.1 sec) 12:19:19.558993 run osmo-hlr_10.42.42.2(pid=20675): ERR: Terminated: ERROR {rc=237} [trial-2404↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20675)] 12:19:19.607102 run osmo-hlr_10.42.42.2(pid=20675): stdout: | (launched: 2022-12-14_12:19:16.508100) 12:19:19.656416 run osmo-hlr_10.42.42.2(pid=20675): stderr: | [0;m[1;31m20221214121916847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121916847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121916847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121916847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121916847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121916847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121916875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121916884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121916884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121916884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:19.725879 run osmo-msc_10.42.42.6(pid=20681): ERR: Terminated: ERROR {rc=2} [trial-2404↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20681)] 12:19:19.773590 run osmo-msc_10.42.42.6(pid=20681): stdout: | (launched: 2022-12-14_12:19:18.660219) 12:19:19.823025 run osmo-msc_10.42.42.6(pid=20681): stderr: | [0;m[38;5;43m20221214121918929 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121918930 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa47301cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121918930 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121918930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121918930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121918930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121918932 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121918932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121918932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121918932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:19.873349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20674): Terminating (SIGTERM) 12:19:19.913379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20677): Terminating (SIGTERM) 12:19:19.953348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20680): Terminating (SIGTERM) 12:19:19.994179 --- ParallelTerminationStrategy: PID 20674 died... 12:19:20.013692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20674): Terminated: ok {rc=0} 12:19:20.058002 --- ParallelTerminationStrategy: PID 20677 died... 12:19:20.076874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20677): Terminated: ok {rc=0} 12:19:20.121259 --- ParallelTerminationStrategy: PID 20680 died... 12:19:20.140103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20680): Terminated: ok {rc=0} 12:19:20.227336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:19:21.436815 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:21.443348 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:19:21.471967 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:19:21.499310 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:19:21.555318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:19:21.586170 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:19:21.613658 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:19:22.162722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:19:22.216162 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:22.227920 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:19:22.293882 tst mo_mt_call.py: using LAC 40851 12:19:22.421288 tst mo_mt_call.py: using RAC 51 12:19:22.547909 tst mo_mt_call.py: using CellId 40851 12:19:22.674884 tst mo_mt_call.py: using BVCI 40852 12:19:22.793622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:22.805423 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:22.817137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:22.828689 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:22.840394 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:22.852015 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:19:22.970831 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:19:23.092324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:23.599267 run create_hlr_db(pid=20686): Launched 12:19:23.730769 bus /sierra_2: Setting Powered False 12:19:24.795615 run create_hlr_db(pid=20686): Terminated: ok {rc=0} 12:19:25.232877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20688): Launched 12:19:25.542024 run osmo-hlr_10.42.42.2(pid=20689): Launched 12:19:25.660370 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:26.191797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20691): Launched 12:19:26.497918 run osmo-stp_10.42.42.5(pid=20692): Launched 12:19:26.616930 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:27.170458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20694): Launched 12:19:27.478649 run osmo-msc_10.42.42.6(pid=20695): Launched 12:19:27.651850 run osmo-stp_10.42.42.5(pid=20692): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20692)] 12:19:27.782088 run osmo-stp_10.42.42.5(pid=20692): stdout: | (launched: 2022-12-14_12:19:26.440400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:27.911609 run osmo-stp_10.42.42.5(pid=20692): stderr: | [0;m[38;5;43m20221214121926612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121926612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121926613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121926613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121926614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121926614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121926614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:28.039681 run osmo-stp_10.42.42.5(pid=20692): stdout: | (launched: 2022-12-14_12:19:26.440400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:28.161087 run osmo-stp_10.42.42.5(pid=20692): stderr: | [0;m[38;5;43m20221214121926612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121926612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121926613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121926613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121926614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121926614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121926614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:28.306133 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20692): Process ended prematurely: osmo-stp_10.42.42.5(pid=20692) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20692)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:19:28.315251 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:19:28.341790 run osmo-hlr_10.42.42.2(pid=20689): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20689)] 12:19:28.390255 run osmo-hlr_10.42.42.2(pid=20689): stdout: | (launched: 2022-12-14_12:19:25.484686) 12:19:28.440045 run osmo-hlr_10.42.42.2(pid=20689): stderr: | [0;m[1;31m20221214121925663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121925663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121925663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121925663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121925663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121925663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121925675 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121925685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121925685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121925686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:28.509440 run osmo-msc_10.42.42.6(pid=20695): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20695)] 12:19:28.557087 run osmo-msc_10.42.42.6(pid=20695): stdout: | (launched: 2022-12-14_12:19:27.421617) 12:19:28.606640 run osmo-msc_10.42.42.6(pid=20695): stderr: | [0;m[38;5;43m20221214121927693 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121927694 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f00709c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121927694 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121927694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121927694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121927694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121927696 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121927696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121927696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121927696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:28.656288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20688): Terminating (SIGTERM) 12:19:28.696225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20691): Terminating (SIGTERM) 12:19:28.736279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20694): Terminating (SIGTERM) 12:19:28.776569 --- ParallelTerminationStrategy: PID 20688 died... 12:19:28.796295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20688): Terminated: ok {rc=0} 12:19:28.840596 --- ParallelTerminationStrategy: PID 20691 died... 12:19:28.859753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20691): Terminated: ok {rc=0} 12:19:28.903822 --- ParallelTerminationStrategy: PID 20694 died... 12:19:28.923053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20694): Terminated: ok {rc=0} 12:19:29.007098 bus /sierra_3: Setting Powered False 12:19:30.102602 bus /sierra_3: Setting Powered False 12:19:31.218281 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:19:32.368227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:32.380673 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:19:32.449468 tst mo_mt_call_osmux.py: using LAC 40852 12:19:32.578805 tst mo_mt_call_osmux.py: using RAC 52 12:19:32.712115 tst mo_mt_call_osmux.py: using CellId 40852 12:19:32.839367 tst mo_mt_call_osmux.py: using BVCI 40853 12:19:32.957954 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:32.969799 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:32.981846 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:32.993538 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:33.005366 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:33.016913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:19:33.135716 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:19:33.253380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:33.730969 run create_hlr_db(pid=20697): Launched 12:19:33.850096 bus /sierra_2: Setting Powered False 12:19:34.910951 run create_hlr_db(pid=20697): Terminated: ok {rc=0} 12:19:35.360494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20699): Launched 12:19:35.691030 run osmo-hlr_10.42.42.2(pid=20700): Launched 12:19:35.816618 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:36.386547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20702): Launched 12:19:36.714807 run osmo-stp_10.42.42.5(pid=20703): Launched 12:19:36.839989 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:37.439403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20705): Launched 12:19:37.767751 run osmo-msc_10.42.42.6(pid=20706): Launched 12:19:37.952354 run osmo-stp_10.42.42.5(pid=20703): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20703)] 12:19:38.091462 run osmo-stp_10.42.42.5(pid=20703): stdout: | (launched: 2022-12-14_12:19:36.653954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:38.230400 run osmo-stp_10.42.42.5(pid=20703): stderr: | [0;m[38;5;43m20221214121936848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121936848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121936848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121936849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121936851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121936851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121936851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:38.368125 run osmo-stp_10.42.42.5(pid=20703): stdout: | (launched: 2022-12-14_12:19:36.653954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:38.498654 run osmo-stp_10.42.42.5(pid=20703): stderr: | [0;m[38;5;43m20221214121936848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121936848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121936848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121936849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121936851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121936851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121936851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:38.654506 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20703): Process ended prematurely: osmo-stp_10.42.42.5(pid=20703) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20703)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:19:38.664255 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:19:38.692415 run osmo-hlr_10.42.42.2(pid=20700): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20700)] 12:19:38.742637 run osmo-hlr_10.42.42.2(pid=20700): stdout: | (launched: 2022-12-14_12:19:35.630036) 12:19:38.794547 run osmo-hlr_10.42.42.2(pid=20700): stderr: | [0;m[1;31m20221214121935832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121935832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121935832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121935833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121935833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121935833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121935847 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121935857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121935858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121935858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:38.867276 run osmo-msc_10.42.42.6(pid=20706): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20706)] 12:19:38.917372 run osmo-msc_10.42.42.6(pid=20706): stdout: | (launched: 2022-12-14_12:19:37.706948) 12:19:38.969235 run osmo-msc_10.42.42.6(pid=20706): stderr: | [0;m[38;5;43m20221214121938031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121938032 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f12f4681c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121938032 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121938032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121938032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121938032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121938034 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121938034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121938034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121938034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:39.021594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20699): Terminating (SIGTERM) 12:19:39.063402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20702): Terminating (SIGTERM) 12:19:39.106000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20705): Terminating (SIGTERM) 12:19:39.148457 --- ParallelTerminationStrategy: PID 20699 died... 12:19:39.168861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20699): Terminated: ok {rc=0} 12:19:39.215405 --- ParallelTerminationStrategy: PID 20702 died... 12:19:39.235283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20702): Terminated: ok {rc=0} 12:19:39.281417 --- ParallelTerminationStrategy: PID 20705 died... 12:19:39.301223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20705): Terminated: ok {rc=0} 12:19:39.389127 bus /sierra_3: Setting Powered False 12:19:40.487575 bus /sierra_3: Setting Powered False 12:19:41.604209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:19:42.853866 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:42.861089 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:19:42.890708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:19:42.918340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:19:42.971834 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:19:43.003022 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:19:43.030587 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:19:43.578639 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:19:43.629518 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:43.640669 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:19:43.706052 tst mo_mt_call.py: using LAC 40853 12:19:43.827104 tst mo_mt_call.py: using RAC 53 12:19:43.947014 tst mo_mt_call.py: using CellId 40853 12:19:44.069401 tst mo_mt_call.py: using BVCI 40854 12:19:44.189688 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:44.201660 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:44.213437 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:44.225294 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:44.237180 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:44.248802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:44.366304 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:44.489965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:45.000214 run create_hlr_db(pid=20712): Launched 12:19:45.134706 bus /sierra_2: Setting Powered False 12:19:46.199300 run create_hlr_db(pid=20712): Terminated: ok {rc=0} 12:19:46.668097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20714): Launched 12:19:47.016262 run osmo-hlr_10.42.42.2(pid=20715): Launched 12:19:47.217576 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:47.783223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20717): Launched 12:19:48.114611 run osmo-stp_10.42.42.5(pid=20718): Launched 12:19:48.240216 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:48.833557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20720): Launched 12:19:49.163416 run osmo-msc_10.42.42.6(pid=20721): Launched 12:19:49.347811 run osmo-stp_10.42.42.5(pid=20718): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20718)] 12:19:49.486450 run osmo-stp_10.42.42.5(pid=20718): stdout: | (launched: 2022-12-14_12:19:48.053627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:49.625611 run osmo-stp_10.42.42.5(pid=20718): stderr: | [0;m[38;5;43m20221214121948253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121948253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121948253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121948254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121948254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121948254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121948254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:49.763464 run osmo-stp_10.42.42.5(pid=20718): stdout: | (launched: 2022-12-14_12:19:48.053627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:49.893482 run osmo-stp_10.42.42.5(pid=20718): stderr: | [0;m[38;5;43m20221214121948253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121948253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121948253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121948254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121948254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121948254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121948254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:50.050942 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20718): Process ended prematurely: osmo-stp_10.42.42.5(pid=20718) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20718)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:19:50.060694 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:19:50.088666 run osmo-hlr_10.42.42.2(pid=20715): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20715)] 12:19:50.138746 run osmo-hlr_10.42.42.2(pid=20715): stdout: | (launched: 2022-12-14_12:19:46.952262) 12:19:50.190351 run osmo-hlr_10.42.42.2(pid=20715): stderr: | [0;m[1;31m20221214121947204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121947204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121947204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121947204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121947204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121947204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121947216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121947224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121947225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121947225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:50.262350 run osmo-msc_10.42.42.6(pid=20721): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20721)] 12:19:50.311883 run osmo-msc_10.42.42.6(pid=20721): stdout: | (launched: 2022-12-14_12:19:49.102310) 12:19:50.363125 run osmo-msc_10.42.42.6(pid=20721): stderr: | [0;m[38;5;43m20221214121949425 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121949425 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1c5c67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121949426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121949426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121949426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121949426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121949430 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121949430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121949430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121949430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:50.414658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20714): Terminating (SIGTERM) 12:19:50.456186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20717): Terminating (SIGTERM) 12:19:50.498366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20720): Terminating (SIGTERM) 12:19:50.540538 --- ParallelTerminationStrategy: PID 20714 died... 12:19:50.560799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20714): Terminated: ok {rc=0} 12:19:50.606809 --- ParallelTerminationStrategy: PID 20717 died... 12:19:50.626540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20717): Terminated: ok {rc=0} 12:19:50.672346 --- ParallelTerminationStrategy: PID 20720 died... 12:19:50.692070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20720): Terminated: ok {rc=0} 12:19:50.779283 bus /sierra_3: Setting Powered False 12:19:51.878151 bus /sierra_3: Setting Powered False 12:19:52.994838 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:19:54.147805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:54.160340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:19:54.229086 tst mo_mt_call_osmux.py: using LAC 40854 12:19:54.358349 tst mo_mt_call_osmux.py: using RAC 54 12:19:54.488841 tst mo_mt_call_osmux.py: using CellId 40854 12:19:54.621799 tst mo_mt_call_osmux.py: using BVCI 40855 12:19:54.743094 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:54.754973 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:54.766759 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:54.778370 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:54.790521 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:54.802602 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:54.921426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:55.044575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:55.554122 run create_hlr_db(pid=20723): Launched 12:19:55.688849 bus /sierra_2: Setting Powered False 12:19:56.754184 run create_hlr_db(pid=20723): Terminated: ok {rc=0} 12:19:57.212046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20725): Launched 12:19:57.541375 run osmo-hlr_10.42.42.2(pid=20726): Launched 12:19:57.667389 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:58.232663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20728): Launched 12:19:58.561207 run osmo-stp_10.42.42.5(pid=20729): Launched 12:19:58.687114 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:59.283202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20731): Launched 12:19:59.612928 run osmo-msc_10.42.42.6(pid=20732): Launched 12:19:59.795795 run osmo-stp_10.42.42.5(pid=20729): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20729)] 12:19:59.934833 run osmo-stp_10.42.42.5(pid=20729): stdout: | (launched: 2022-12-14_12:19:58.500277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:00.075297 run osmo-stp_10.42.42.5(pid=20729): stderr: | [0;m[38;5;43m20221214121958696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121958696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121958696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121958697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121958697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121958697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121958697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:00.214095 run osmo-stp_10.42.42.5(pid=20729): stdout: | (launched: 2022-12-14_12:19:58.500277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:00.344766 run osmo-stp_10.42.42.5(pid=20729): stderr: | [0;m[38;5;43m20221214121958696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214121958696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214121958696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214121958697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214121958697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214121958697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214121958697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:00.501536 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20729): Process ended prematurely: osmo-stp_10.42.42.5(pid=20729) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20729)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:20:00.511363 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:20:00.539549 run osmo-hlr_10.42.42.2(pid=20726): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20726)] 12:20:00.589823 run osmo-hlr_10.42.42.2(pid=20726): stdout: | (launched: 2022-12-14_12:19:57.480276) 12:20:00.641814 run osmo-hlr_10.42.42.2(pid=20726): stderr: | [0;m[1;31m20221214121957681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214121957681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214121957681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214121957681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214121957681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214121957681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214121957694 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214121957702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214121957702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214121957702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:00.714518 run osmo-msc_10.42.42.6(pid=20732): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20732)] 12:20:00.764692 run osmo-msc_10.42.42.6(pid=20732): stdout: | (launched: 2022-12-14_12:19:59.551563) 12:20:00.816456 run osmo-msc_10.42.42.6(pid=20732): stderr: | [0;m[38;5;43m20221214121959874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214121959874 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1109639c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214121959874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214121959875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214121959875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214121959875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214121959876 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214121959877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214121959877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214121959877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:00.886254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20725): Terminating (SIGTERM) 12:20:00.929213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20728): Terminating (SIGTERM) 12:20:00.972551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20731): Terminating (SIGTERM) 12:20:01.017652 --- ParallelTerminationStrategy: PID 20725 died... 12:20:01.038524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20725): Terminated: ok {rc=0} 12:20:01.086434 --- ParallelTerminationStrategy: PID 20728 died... 12:20:01.107077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20728): Terminated: ok {rc=0} 12:20:01.165843 --- ParallelTerminationStrategy: PID 20731 died... 12:20:01.186288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20731): Terminated: ok {rc=0} 12:20:01.287553 bus /sierra_3: Setting Powered False 12:20:02.402694 bus /sierra_3: Setting Powered False 12:20:03.521143 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:20:04.770804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:04.777767 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:20:04.807229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:20:04.835729 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:20:04.888488 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:20:04.918946 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:20:04.947535 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:20:05.496706 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:20:05.547468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:05.559071 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:20:05.624491 tst mo_mt_call.py: using LAC 40855 12:20:05.744308 tst mo_mt_call.py: using RAC 55 12:20:05.865898 tst mo_mt_call.py: using CellId 40855 12:20:05.989250 tst mo_mt_call.py: using BVCI 40856 12:20:06.102742 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:06.114535 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:06.125974 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:06.137304 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:06.148884 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:06.160549 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:20:06.283905 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:20:06.402895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:06.915765 run create_hlr_db(pid=20747): Launched 12:20:07.050994 bus /sierra_2: Setting Powered False 12:20:08.116929 run create_hlr_db(pid=20747): Terminated: ok {rc=0} 12:20:08.558672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20749): Launched 12:20:08.869023 run osmo-hlr_10.42.42.2(pid=20750): Launched 12:20:08.986963 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:09.530541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20752): Launched 12:20:09.839078 run osmo-stp_10.42.42.5(pid=20753): Launched 12:20:09.957493 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:10.530406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20755): Launched 12:20:10.840133 run osmo-msc_10.42.42.6(pid=20756): Launched 12:20:11.013862 run osmo-stp_10.42.42.5(pid=20753): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20753)] 12:20:11.144130 run osmo-stp_10.42.42.5(pid=20753): stdout: | (launched: 2022-12-14_12:20:09.781654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:11.274997 run osmo-stp_10.42.42.5(pid=20753): stderr: | [0;m[38;5;43m20221214122009952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122009952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122009953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122009953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122009955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122009955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122009955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:11.403587 run osmo-stp_10.42.42.5(pid=20753): stdout: | (launched: 2022-12-14_12:20:09.781654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:11.525822 run osmo-stp_10.42.42.5(pid=20753): stderr: | [0;m[38;5;43m20221214122009952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122009952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122009953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122009953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122009955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122009955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122009955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:11.672057 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20753): Process ended prematurely: osmo-stp_10.42.42.5(pid=20753) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20753)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:20:11.681294 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:20:11.707832 run osmo-hlr_10.42.42.2(pid=20750): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20750)] 12:20:11.756622 run osmo-hlr_10.42.42.2(pid=20750): stdout: | (launched: 2022-12-14_12:20:08.811280) 12:20:11.806360 run osmo-hlr_10.42.42.2(pid=20750): stderr: | [0;m[1;31m20221214122008988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122008988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122008988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122008988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122008988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122008988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122009001 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122009010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122009010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122009010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:11.878077 run osmo-msc_10.42.42.6(pid=20756): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20756)] 12:20:11.927038 run osmo-msc_10.42.42.6(pid=20756): stdout: | (launched: 2022-12-14_12:20:10.782727) 12:20:11.980207 run osmo-msc_10.42.42.6(pid=20756): stderr: | [0;m[38;5;43m20221214122011055 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122011055 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe8d0166c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122011055 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122011055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122011056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122011056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122011058 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122011058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122011058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122011058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:12.032348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20749): Terminating (SIGTERM) 12:20:12.074854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20752): Terminating (SIGTERM) 12:20:12.117252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20755): Terminating (SIGTERM) 12:20:12.160356 --- ParallelTerminationStrategy: PID 20749 died... 12:20:12.181353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20749): Terminated: ok {rc=0} 12:20:12.227497 --- ParallelTerminationStrategy: PID 20752 died... 12:20:12.247972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20752): Terminated: ok {rc=0} 12:20:12.293975 --- ParallelTerminationStrategy: PID 20755 died... 12:20:12.314704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20755): Terminated: ok {rc=0} 12:20:12.403013 bus /sierra_3: Setting Powered False 12:20:13.500676 bus /sierra_3: Setting Powered False 12:20:14.616065 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:20:15.759893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:15.772053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:20:15.839013 tst mo_mt_call_osmux.py: using LAC 40856 12:20:15.974991 tst mo_mt_call_osmux.py: using RAC 56 12:20:16.107845 tst mo_mt_call_osmux.py: using CellId 40856 12:20:16.236827 tst mo_mt_call_osmux.py: using BVCI 40857 12:20:16.370836 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:16.383701 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:16.395985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:16.409254 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:16.421629 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:16.434368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:20:16.563573 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:20:16.703243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:17.264011 run create_hlr_db(pid=21109): Launched 12:20:17.429993 bus /sierra_2: Setting Powered False 12:20:18.495567 run create_hlr_db(pid=21109): Terminated: ok {rc=0} 12:20:18.934309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21111): Launched 12:20:19.241823 run osmo-hlr_10.42.42.2(pid=21112): Launched 12:20:19.369760 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:19.939159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21114): Launched 12:20:20.269100 run osmo-stp_10.42.42.5(pid=21115): Launched 12:20:20.395733 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:20.989409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21117): Launched 12:20:21.318726 run osmo-msc_10.42.42.6(pid=21118): Launched 12:20:21.502737 run osmo-stp_10.42.42.5(pid=21115): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21115)] 12:20:21.640420 run osmo-stp_10.42.42.5(pid=21115): stdout: | (launched: 2022-12-14_12:20:20.207504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:21.778789 run osmo-stp_10.42.42.5(pid=21115): stderr: | [0;m[38;5;43m20221214122020406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122020406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122020406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122020407 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122020407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122020407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122020407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:21.916149 run osmo-stp_10.42.42.5(pid=21115): stdout: | (launched: 2022-12-14_12:20:20.207504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:22.046843 run osmo-stp_10.42.42.5(pid=21115): stderr: | [0;m[38;5;43m20221214122020406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122020406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122020406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122020407 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122020407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122020407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122020407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:22.202531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21115): Process ended prematurely: osmo-stp_10.42.42.5(pid=21115) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21115)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:20:22.212166 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:20:22.240556 run osmo-hlr_10.42.42.2(pid=21112): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21112)] 12:20:22.290643 run osmo-hlr_10.42.42.2(pid=21112): stdout: | (launched: 2022-12-14_12:20:19.184877) 12:20:22.342415 run osmo-hlr_10.42.42.2(pid=21112): stderr: | [0;m[1;31m20221214122019385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122019385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122019385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122019386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122019386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122019386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122019398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122019406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122019406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122019406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:22.414983 run osmo-msc_10.42.42.6(pid=21118): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21118)] 12:20:22.464889 run osmo-msc_10.42.42.6(pid=21118): stdout: | (launched: 2022-12-14_12:20:21.257521) 12:20:22.516697 run osmo-msc_10.42.42.6(pid=21118): stderr: | [0;m[38;5;43m20221214122021584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122021584 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f238aaf6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122021584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122021584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122021584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122021584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122021586 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122021587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122021587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122021587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:22.569158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21111): Terminating (SIGTERM) 12:20:22.611403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21114): Terminating (SIGTERM) 12:20:22.653274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21117): Terminating (SIGTERM) 12:20:22.695460 --- ParallelTerminationStrategy: PID 21111 died... 12:20:22.717341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21111): Terminated: ok {rc=0} 12:20:22.765248 --- ParallelTerminationStrategy: PID 21114 died... 12:20:22.789548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21114): Terminated: ok {rc=0} 12:20:22.836422 --- ParallelTerminationStrategy: PID 21117 died... 12:20:22.856818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21117): Terminated: ok {rc=0} 12:20:22.947228 bus /sierra_3: Setting Powered False 12:20:24.049369 bus /sierra_3: Setting Powered False 12:20:25.168677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:20:26.426438 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:26.434309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:20:26.465487 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:20:26.495028 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:20:26.547582 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:20:26.578939 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:20:26.608903 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:20:27.157497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:20:27.213571 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:27.226329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:20:27.294473 tst mo_mt_call.py: using LAC 40857 12:20:27.420787 tst mo_mt_call.py: using RAC 57 12:20:27.545817 tst mo_mt_call.py: using CellId 40857 12:20:27.668108 tst mo_mt_call.py: using BVCI 40858 12:20:27.783665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:27.796378 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:27.810048 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:27.822527 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:27.836000 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:27.849615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:20:27.972422 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:20:28.095626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:28.594572 run create_hlr_db(pid=21300): Launched 12:20:28.715330 bus /sierra_2: Setting Powered False 12:20:29.776215 run create_hlr_db(pid=21300): Terminated: ok {rc=0} 12:20:30.206445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21302): Launched 12:20:30.516138 run osmo-hlr_10.42.42.2(pid=21303): Launched 12:20:30.632930 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:31.203110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21305): Launched 12:20:31.529863 run osmo-stp_10.42.42.5(pid=21306): Launched 12:20:31.781788 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:32.630522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21308): Launched 12:20:32.959370 run osmo-msc_10.42.42.6(pid=21309): Launched 12:20:33.143769 run osmo-stp_10.42.42.5(pid=21306): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21306)] 12:20:33.281799 run osmo-stp_10.42.42.5(pid=21306): stdout: | (launched: 2022-12-14_12:20:31.471119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:33.421282 run osmo-stp_10.42.42.5(pid=21306): stderr: | [0;m[38;5;43m20221214122031860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122031860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122031860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122031861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122031863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122031864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122031864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:33.559209 run osmo-stp_10.42.42.5(pid=21306): stdout: | (launched: 2022-12-14_12:20:31.471119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:33.689075 run osmo-stp_10.42.42.5(pid=21306): stderr: | [0;m[38;5;43m20221214122031860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122031860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122031860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122031861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122031863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122031864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122031864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:33.845616 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21306): Process ended prematurely: osmo-stp_10.42.42.5(pid=21306) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21306)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:20:33.855265 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 12:20:33.883208 run osmo-hlr_10.42.42.2(pid=21303): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21303)] 12:20:33.933377 run osmo-hlr_10.42.42.2(pid=21303): stdout: | (launched: 2022-12-14_12:20:30.458937) 12:20:33.985319 run osmo-hlr_10.42.42.2(pid=21303): stderr: | [0;m[1;31m20221214122030642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122030642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122030642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122030642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122030642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122030642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122030654 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122030663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122030663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122030663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:34.057683 run osmo-msc_10.42.42.6(pid=21309): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21309)] 12:20:34.107473 run osmo-msc_10.42.42.6(pid=21309): stdout: | (launched: 2022-12-14_12:20:32.898425) 12:20:34.158808 run osmo-msc_10.42.42.6(pid=21309): stderr: | [0;m[38;5;43m20221214122033224 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122033224 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8e1bcc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122033224 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122033224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122033224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122033224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122033226 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122033226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122033227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122033227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:34.211125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21302): Terminating (SIGTERM) 12:20:34.252740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21305): Terminating (SIGTERM) 12:20:34.294563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21308): Terminating (SIGTERM) 12:20:34.337305 --- ParallelTerminationStrategy: PID 21302 died... 12:20:34.357446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21302): Terminated: ok {rc=0} 12:20:34.403515 --- ParallelTerminationStrategy: PID 21305 died... 12:20:34.423103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21305): Terminated: ok {rc=0} 12:20:34.469102 --- ParallelTerminationStrategy: PID 21308 died... 12:20:34.488553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21308): Terminated: ok {rc=0} 12:20:34.575975 bus /sierra_3: Setting Powered False 12:20:35.675456 bus /sierra_3: Setting Powered False 12:20:36.792241 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:20:37.942341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:37.954846 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:20:38.023115 tst mo_mt_call_osmux.py: using LAC 40858 12:20:38.151655 tst mo_mt_call_osmux.py: using RAC 58 12:20:38.280344 tst mo_mt_call_osmux.py: using CellId 40858 12:20:38.410630 tst mo_mt_call_osmux.py: using BVCI 40859 12:20:38.529821 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:38.541714 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:38.553330 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:38.565426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:38.577218 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:20:38.588758 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:20:38.706752 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:20:38.823530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:39.301051 run create_hlr_db(pid=21311): Launched 12:20:39.419553 bus /sierra_2: Setting Powered False 12:20:40.481800 run create_hlr_db(pid=21311): Terminated: ok {rc=0} 12:20:40.930932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21313): Launched 12:20:41.261421 run osmo-hlr_10.42.42.2(pid=21314): Launched 12:20:41.387374 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:41.954911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21316): Launched 12:20:42.284391 run osmo-stp_10.42.42.5(pid=21317): Launched 12:20:42.411792 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:43.007276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21319): Launched 12:20:43.336835 run osmo-msc_10.42.42.6(pid=21320): Launched 12:20:43.522250 run osmo-stp_10.42.42.5(pid=21317): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21317)] 12:20:43.660665 run osmo-stp_10.42.42.5(pid=21317): stdout: | (launched: 2022-12-14_12:20:42.223536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:43.800468 run osmo-stp_10.42.42.5(pid=21317): stderr: | [0;m[38;5;43m20221214122042420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122042420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122042420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122042421 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122042421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122042421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122042421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:43.937487 run osmo-stp_10.42.42.5(pid=21317): stdout: | (launched: 2022-12-14_12:20:42.223536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:44.068533 run osmo-stp_10.42.42.5(pid=21317): stderr: | [0;m[38;5;43m20221214122042420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122042420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122042420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122042421 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122042421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122042421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122042421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:44.224492 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21317): Process ended prematurely: osmo-stp_10.42.42.5(pid=21317) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21317)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:20:44.234177 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:20:44.262071 run osmo-hlr_10.42.42.2(pid=21314): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21314)] 12:20:44.312317 run osmo-hlr_10.42.42.2(pid=21314): stdout: | (launched: 2022-12-14_12:20:41.200343) 12:20:44.364564 run osmo-hlr_10.42.42.2(pid=21314): stderr: | [0;m[1;31m20221214122041402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122041402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122041402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122041402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122041402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122041402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122041414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122041422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122041423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122041423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:44.437760 run osmo-msc_10.42.42.6(pid=21320): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21320)] 12:20:44.487891 run osmo-msc_10.42.42.6(pid=21320): stdout: | (launched: 2022-12-14_12:20:43.275568) 12:20:44.539791 run osmo-msc_10.42.42.6(pid=21320): stderr: | [0;m[38;5;43m20221214122043599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122043599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa237141c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122043599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122043599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122043599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122043600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122043601 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122043602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122043602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122043602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:44.592010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21313): Terminating (SIGTERM) 12:20:44.634056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21316): Terminating (SIGTERM) 12:20:44.675892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21319): Terminating (SIGTERM) 12:20:44.718214 --- ParallelTerminationStrategy: PID 21313 died... 12:20:44.738332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21313): Terminated: ok {rc=0} 12:20:44.784747 --- ParallelTerminationStrategy: PID 21316 died... 12:20:44.804519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21316): Terminated: ok {rc=0} 12:20:44.850676 --- ParallelTerminationStrategy: PID 21319 died... 12:20:44.870459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21319): Terminated: ok {rc=0} 12:20:44.958017 bus /sierra_3: Setting Powered False 12:20:46.064937 bus /sierra_3: Setting Powered False 12:20:47.202335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:20:48.444627 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:48.451168 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:20:48.479779 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:20:48.507145 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:20:48.559126 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:20:48.588408 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:20:48.615010 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:20:49.171000 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:20:49.221616 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:49.232778 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:20:49.298583 tst mo_mt_call.py: using LAC 40859 12:20:49.418941 tst mo_mt_call.py: using RAC 59 12:20:49.540894 tst mo_mt_call.py: using CellId 40859 12:20:49.659765 tst mo_mt_call.py: using BVCI 40860 12:20:49.771835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:49.783194 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:49.794470 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:49.805710 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:49.817118 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:49.828490 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:49.950712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:50.067682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:50.543035 run create_hlr_db(pid=21325): Launched 12:20:50.661493 bus /sierra_2: Setting Powered False 12:20:51.723079 run create_hlr_db(pid=21325): Terminated: ok {rc=0} 12:20:52.168463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21331): Launched 12:20:52.500259 run osmo-hlr_10.42.42.2(pid=21335): Launched 12:20:52.627247 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:53.195463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21337): Launched 12:20:53.524344 run osmo-stp_10.42.42.5(pid=21338): Launched 12:20:53.650879 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:54.246391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21340): Launched 12:20:54.575467 run osmo-msc_10.42.42.6(pid=21341): Launched 12:20:54.759995 run osmo-stp_10.42.42.5(pid=21338): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21338)] 12:20:54.899026 run osmo-stp_10.42.42.5(pid=21338): stdout: | (launched: 2022-12-14_12:20:53.463725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:55.038886 run osmo-stp_10.42.42.5(pid=21338): stderr: | [0;m[38;5;43m20221214122053660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122053660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122053661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122053661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122053662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122053662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122053662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:55.177219 run osmo-stp_10.42.42.5(pid=21338): stdout: | (launched: 2022-12-14_12:20:53.463725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:55.307995 run osmo-stp_10.42.42.5(pid=21338): stderr: | [0;m[38;5;43m20221214122053660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122053660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122053661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122053661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122053662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122053662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122053662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:55.464758 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21338): Process ended prematurely: osmo-stp_10.42.42.5(pid=21338) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21338)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:20:55.474530 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:20:55.502189 run osmo-hlr_10.42.42.2(pid=21335): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21335)] 12:20:55.552057 run osmo-hlr_10.42.42.2(pid=21335): stdout: | (launched: 2022-12-14_12:20:52.438783) 12:20:55.603719 run osmo-hlr_10.42.42.2(pid=21335): stderr: | [0;m[1;31m20221214122052638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122052638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122052638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122052638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122052638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122052638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122052650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122052659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122052659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122052659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:55.676019 run osmo-msc_10.42.42.6(pid=21341): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21341)] 12:20:55.725694 run osmo-msc_10.42.42.6(pid=21341): stdout: | (launched: 2022-12-14_12:20:54.514145) 12:20:55.776840 run osmo-msc_10.42.42.6(pid=21341): stderr: | [0;m[38;5;43m20221214122054837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122054837 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc5f5819c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122054837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122054837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122054837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122054838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122054839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122054840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122054840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122054840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:55.828657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21331): Terminating (SIGTERM) 12:20:55.870275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21337): Terminating (SIGTERM) 12:20:55.911869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21340): Terminating (SIGTERM) 12:20:55.954275 --- ParallelTerminationStrategy: PID 21331 died... 12:20:55.974234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21331): Terminated: ok {rc=0} 12:20:56.020293 --- ParallelTerminationStrategy: PID 21337 died... 12:20:56.039892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21337): Terminated: ok {rc=0} 12:20:56.085821 --- ParallelTerminationStrategy: PID 21340 died... 12:20:56.105388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21340): Terminated: ok {rc=0} 12:20:56.193419 bus /sierra_3: Setting Powered False 12:20:57.292637 bus /sierra_3: Setting Powered False 12:20:58.409583 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:20:59.559282 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:59.571954 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:20:59.639141 tst mo_mt_call_osmux.py: using LAC 40860 12:20:59.766502 tst mo_mt_call_osmux.py: using RAC 60 12:20:59.893442 tst mo_mt_call_osmux.py: using CellId 40860 12:21:00.022319 tst mo_mt_call_osmux.py: using BVCI 40861 12:21:00.141784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:21:00.153674 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:21:00.165601 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:21:00.177243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:21:00.188892 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:21:00.200635 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:21:00.322431 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:21:00.441057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:00.945665 run create_hlr_db(pid=21343): Launched 12:21:01.108237 bus /sierra_2: Setting Powered False 12:21:02.187113 run create_hlr_db(pid=21343): Terminated: ok {rc=0} 12:21:02.644011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21345): Launched 12:21:02.975020 run osmo-hlr_10.42.42.2(pid=21346): Launched 12:21:03.101602 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:03.668513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21348): Launched 12:21:03.998523 run osmo-stp_10.42.42.5(pid=21349): Launched 12:21:04.124297 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:04.720500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21351): Launched 12:21:05.050628 run osmo-msc_10.42.42.6(pid=21352): Launched 12:21:05.236874 run osmo-stp_10.42.42.5(pid=21349): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21349)] 12:21:05.375867 run osmo-stp_10.42.42.5(pid=21349): stdout: | (launched: 2022-12-14_12:21:03.937653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:05.514902 run osmo-stp_10.42.42.5(pid=21349): stderr: | [0;m[38;5;43m20221214122104134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122104134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122104134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122104134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122104135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122104135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122104135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:05.652447 run osmo-stp_10.42.42.5(pid=21349): stdout: | (launched: 2022-12-14_12:21:03.937653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:05.782562 run osmo-stp_10.42.42.5(pid=21349): stderr: | [0;m[38;5;43m20221214122104134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122104134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122104134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122104134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122104135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122104135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122104135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:05.938446 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21349): Process ended prematurely: osmo-stp_10.42.42.5(pid=21349) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21349)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:21:05.948073 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:21:05.976155 run osmo-hlr_10.42.42.2(pid=21346): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21346)] 12:21:06.026645 run osmo-hlr_10.42.42.2(pid=21346): stdout: | (launched: 2022-12-14_12:21:02.913897) 12:21:06.078489 run osmo-hlr_10.42.42.2(pid=21346): stderr: | [0;m[1;31m20221214122103117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122103117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122103117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122103117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122103117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122103117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122103131 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122103142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122103142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122103142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:06.150925 run osmo-msc_10.42.42.6(pid=21352): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21352)] 12:21:06.200700 run osmo-msc_10.42.42.6(pid=21352): stdout: | (launched: 2022-12-14_12:21:04.988737) 12:21:06.252137 run osmo-msc_10.42.42.6(pid=21352): stderr: | [0;m[38;5;43m20221214122105314 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122105314 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7372dbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122105314 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122105314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122105315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122105315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122105316 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122105317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122105317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122105317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:06.304129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21345): Terminating (SIGTERM) 12:21:06.346102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21348): Terminating (SIGTERM) 12:21:06.388032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21351): Terminating (SIGTERM) 12:21:06.430690 --- ParallelTerminationStrategy: PID 21345 died... 12:21:06.450790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21345): Terminated: ok {rc=0} 12:21:06.496906 --- ParallelTerminationStrategy: PID 21348 died... 12:21:06.516566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21348): Terminated: ok {rc=0} 12:21:06.562569 --- ParallelTerminationStrategy: PID 21351 died... 12:21:06.582604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21351): Terminated: ok {rc=0} 12:21:06.671026 bus /sierra_3: Setting Powered False 12:21:07.769907 bus /sierra_3: Setting Powered False 12:21:08.890200 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:21:10.144096 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:10.151208 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:21:10.180843 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:21:10.208438 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:21:10.261761 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:21:10.291690 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:21:10.319139 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:21:10.870407 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:21:10.919620 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:10.931017 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:21:10.997406 tst mo_mt_call.py: using LAC 40861 12:21:11.119384 tst mo_mt_call.py: using RAC 61 12:21:11.240528 tst mo_mt_call.py: using CellId 40861 12:21:11.361623 tst mo_mt_call.py: using BVCI 40862 12:21:11.472312 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.483721 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.494919 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.506181 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.517794 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.529353 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:11.650583 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:11.768696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:12.244443 run create_hlr_db(pid=21357): Launched 12:21:12.361961 bus /sierra_2: Setting Powered False 12:21:13.422867 run create_hlr_db(pid=21357): Terminated: ok {rc=0} 12:21:13.851158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21359): Launched 12:21:14.160111 run osmo-hlr_10.42.42.2(pid=21360): Launched 12:21:14.276861 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:14.821223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21362): Launched 12:21:15.127791 run osmo-stp_10.42.42.5(pid=21363): Launched 12:21:15.246505 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:15.802877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21365): Launched 12:21:16.141834 run osmo-msc_10.42.42.6(pid=21366): Launched 12:21:16.487280 run osmo-stp_10.42.42.5(pid=21363): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21363)] 12:21:16.695694 run osmo-stp_10.42.42.5(pid=21363): stdout: | (launched: 2022-12-14_12:21:15.070347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:16.868892 run osmo-stp_10.42.42.5(pid=21363): stderr: | [0;m[38;5;43m20221214122115244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122115244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122115244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122115244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122115245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122115245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122115245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:17.009887 run osmo-stp_10.42.42.5(pid=21363): stdout: | (launched: 2022-12-14_12:21:15.070347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:17.146552 run osmo-stp_10.42.42.5(pid=21363): stderr: | [0;m[38;5;43m20221214122115244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122115244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122115244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122115244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122115245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122115245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122115245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:17.308530 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21363): Process ended prematurely: osmo-stp_10.42.42.5(pid=21363) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21363)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:21:17.318381 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:21:17.346921 run osmo-hlr_10.42.42.2(pid=21360): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21360)] 12:21:17.397838 run osmo-hlr_10.42.42.2(pid=21360): stdout: | (launched: 2022-12-14_12:21:14.102943) 12:21:17.450480 run osmo-hlr_10.42.42.2(pid=21360): stderr: | [0;m[1;31m20221214122114280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122114280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122114280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122114280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122114280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122114281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122114292 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122114300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122114300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122114300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:17.523689 run osmo-msc_10.42.42.6(pid=21366): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21366)] 12:21:17.574141 run osmo-msc_10.42.42.6(pid=21366): stdout: | (launched: 2022-12-14_12:21:16.078638) 12:21:17.626391 run osmo-msc_10.42.42.6(pid=21366): stderr: | [0;m[38;5;43m20221214122116517 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122116517 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc93ea34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122116517 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122116517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122116517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122116518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122116519 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122116520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122116520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122116520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:17.679115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21359): Terminating (SIGTERM) 12:21:17.721461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21362): Terminating (SIGTERM) 12:21:17.763618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21365): Terminating (SIGTERM) 12:21:17.806328 --- ParallelTerminationStrategy: PID 21359 died... 12:21:17.826621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21359): Terminated: ok {rc=0} 12:21:17.873438 --- ParallelTerminationStrategy: PID 21362 died... 12:21:17.893265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21362): Terminated: ok {rc=0} 12:21:17.939759 --- ParallelTerminationStrategy: PID 21365 died... 12:21:17.959684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21365): Terminated: ok {rc=0} 12:21:18.049281 bus /sierra_3: Setting Powered False 12:21:19.149154 bus /sierra_3: Setting Powered False 12:21:20.265448 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:21:21.416788 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:21.429545 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:21:21.497593 tst mo_mt_call_osmux.py: using LAC 40862 12:21:21.627162 tst mo_mt_call_osmux.py: using RAC 62 12:21:21.748557 tst mo_mt_call_osmux.py: using CellId 40862 12:21:21.870215 tst mo_mt_call_osmux.py: using BVCI 40863 12:21:21.981603 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:21.993120 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:22.004481 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:22.015948 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:22.028088 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:22.039838 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:22.162453 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:22.281615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:22.759694 run create_hlr_db(pid=21368): Launched 12:21:22.876030 bus /sierra_2: Setting Powered False 12:21:23.937156 run create_hlr_db(pid=21368): Terminated: ok {rc=0} 12:21:24.388087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21370): Launched 12:21:24.719366 run osmo-hlr_10.42.42.2(pid=21371): Launched 12:21:24.845935 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:25.418004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21373): Launched 12:21:25.749517 run osmo-stp_10.42.42.5(pid=21374): Launched 12:21:25.873989 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:26.469444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21376): Launched 12:21:26.800787 run osmo-msc_10.42.42.6(pid=21377): Launched 12:21:26.985312 run osmo-stp_10.42.42.5(pid=21374): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21374)] 12:21:27.123903 run osmo-stp_10.42.42.5(pid=21374): stdout: | (launched: 2022-12-14_12:21:25.688224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:27.262425 run osmo-stp_10.42.42.5(pid=21374): stderr: | [0;m[38;5;43m20221214122125886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122125886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122125886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122125887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122125887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122125887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122125887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:27.399969 run osmo-stp_10.42.42.5(pid=21374): stdout: | (launched: 2022-12-14_12:21:25.688224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:27.530391 run osmo-stp_10.42.42.5(pid=21374): stderr: | [0;m[38;5;43m20221214122125886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122125886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122125886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122125887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122125887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122125887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122125887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:27.686512 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21374): Process ended prematurely: osmo-stp_10.42.42.5(pid=21374) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21374)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:21:27.696244 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:21:27.724316 run osmo-hlr_10.42.42.2(pid=21371): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21371)] 12:21:27.774641 run osmo-hlr_10.42.42.2(pid=21371): stdout: | (launched: 2022-12-14_12:21:24.657964) 12:21:27.826649 run osmo-hlr_10.42.42.2(pid=21371): stderr: | [0;m[1;31m20221214122124860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122124860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122124860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122124860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122124860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122124861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122124876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122124885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122124885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122124885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:27.899296 run osmo-msc_10.42.42.6(pid=21377): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21377)] 12:21:27.949492 run osmo-msc_10.42.42.6(pid=21377): stdout: | (launched: 2022-12-14_12:21:26.738837) 12:21:28.001267 run osmo-msc_10.42.42.6(pid=21377): stderr: | [0;m[38;5;43m20221214122127063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122127063 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ffd5e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122127063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122127063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122127063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122127064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122127065 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122127066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122127066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122127066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:28.053673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21370): Terminating (SIGTERM) 12:21:28.095773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21373): Terminating (SIGTERM) 12:21:28.137968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21376): Terminating (SIGTERM) 12:21:28.180424 --- ParallelTerminationStrategy: PID 21370 died... 12:21:28.200756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21370): Terminated: ok {rc=0} 12:21:28.247142 --- ParallelTerminationStrategy: PID 21373 died... 12:21:28.267001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21373): Terminated: ok {rc=0} 12:21:28.313456 --- ParallelTerminationStrategy: PID 21376 died... 12:21:28.333397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21376): Terminated: ok {rc=0} 12:21:28.421527 bus /sierra_3: Setting Powered False 12:21:29.520039 bus /sierra_3: Setting Powered False 12:21:30.635173 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:21:31.915705 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:31.924284 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:21:31.962635 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:21:31.998348 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:21:32.061704 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:21:32.102479 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:21:32.147895 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:21:32.671387 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:21:32.725463 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:32.737296 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:21:32.809822 tst mo_mt_call.py: using LAC 40863 12:21:32.931502 tst mo_mt_call.py: using RAC 63 12:21:33.060654 tst mo_mt_call.py: using CellId 40863 12:21:33.191024 tst mo_mt_call.py: using BVCI 40864 12:21:33.311610 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:33.323495 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:33.335090 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:33.346734 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:33.358650 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:33.370378 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:21:33.488312 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:21:33.608406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:34.119637 run create_hlr_db(pid=21382): Launched 12:21:34.239691 bus /sierra_2: Setting Powered False 12:21:35.300150 run create_hlr_db(pid=21382): Terminated: ok {rc=0} 12:21:35.750105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21384): Launched 12:21:36.079667 run osmo-hlr_10.42.42.2(pid=21385): Launched 12:21:36.206317 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:36.774945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21387): Launched 12:21:37.104484 run osmo-stp_10.42.42.5(pid=21388): Launched 12:21:37.230831 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:37.830499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21390): Launched 12:21:38.163247 run osmo-msc_10.42.42.6(pid=21391): Launched 12:21:38.344659 run osmo-stp_10.42.42.5(pid=21388): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21388)] 12:21:38.478544 run osmo-stp_10.42.42.5(pid=21388): stdout: | (launched: 2022-12-14_12:21:37.043452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:38.609512 run osmo-stp_10.42.42.5(pid=21388): stderr: | [0;m[38;5;43m20221214122137242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122137242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122137242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122137242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122137243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122137243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122137243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:38.738071 run osmo-stp_10.42.42.5(pid=21388): stdout: | (launched: 2022-12-14_12:21:37.043452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:38.860733 run osmo-stp_10.42.42.5(pid=21388): stderr: | [0;m[38;5;43m20221214122137242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122137242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122137242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122137242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122137243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122137243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122137243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:39.007675 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21388): Process ended prematurely: osmo-stp_10.42.42.5(pid=21388) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21388)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:21:39.016805 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:21:39.043731 run osmo-hlr_10.42.42.2(pid=21385): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21385)] 12:21:39.092362 run osmo-hlr_10.42.42.2(pid=21385): stdout: | (launched: 2022-12-14_12:21:36.018257) 12:21:39.142298 run osmo-hlr_10.42.42.2(pid=21385): stderr: | [0;m[1;31m20221214122136220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122136220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122136220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122136220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122136220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122136220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122136233 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122136241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122136241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122136241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:39.212072 run osmo-msc_10.42.42.6(pid=21391): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21391)] 12:21:39.259914 run osmo-msc_10.42.42.6(pid=21391): stdout: | (launched: 2022-12-14_12:21:38.101939) 12:21:39.309657 run osmo-msc_10.42.42.6(pid=21391): stderr: | [0;m[38;5;43m20221214122138387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122138387 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd7780abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122138387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122138387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122138387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122138387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122138389 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122138389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122138390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122138390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:39.359776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21384): Terminating (SIGTERM) 12:21:39.400174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21387): Terminating (SIGTERM) 12:21:39.440401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21390): Terminating (SIGTERM) 12:21:39.482058 --- ParallelTerminationStrategy: PID 21384 died... 12:21:39.501434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21384): Terminated: ok {rc=0} 12:21:39.546092 --- ParallelTerminationStrategy: PID 21387 died... 12:21:39.565327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21387): Terminated: ok {rc=0} 12:21:39.610013 --- ParallelTerminationStrategy: PID 21390 died... 12:21:39.629273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21390): Terminated: ok {rc=0} 12:21:39.715582 bus /sierra_3: Setting Powered False 12:21:40.816369 bus /sierra_3: Setting Powered False 12:21:41.934196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:21:43.087756 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:43.100373 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:21:43.169905 tst mo_mt_call_osmux.py: using LAC 40864 12:21:43.300280 tst mo_mt_call_osmux.py: using RAC 64 12:21:43.428761 tst mo_mt_call_osmux.py: using CellId 40864 12:21:43.556541 tst mo_mt_call_osmux.py: using BVCI 40865 12:21:43.677470 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:43.689252 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:43.700663 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:43.712185 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:43.723943 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:21:43.735592 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:21:43.853784 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:21:43.976051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:44.486997 run create_hlr_db(pid=21393): Launched 12:21:44.620862 bus /sierra_2: Setting Powered False 12:21:45.686548 run create_hlr_db(pid=21393): Terminated: ok {rc=0} 12:21:46.185620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21395): Launched 12:21:46.535904 run osmo-hlr_10.42.42.2(pid=21396): Launched 12:21:46.780871 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:47.529570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21398): Launched 12:21:47.838368 run osmo-stp_10.42.42.5(pid=21399): Launched 12:21:47.956701 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:48.526257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21401): Launched 12:21:48.835770 run osmo-msc_10.42.42.6(pid=21402): Launched 12:21:49.008880 run osmo-stp_10.42.42.5(pid=21399): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21399)] 12:21:49.139093 run osmo-stp_10.42.42.5(pid=21399): stdout: | (launched: 2022-12-14_12:21:47.780523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:49.268794 run osmo-stp_10.42.42.5(pid=21399): stderr: | [0;m[38;5;43m20221214122147954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122147954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122147955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122147955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122147955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122147956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122147956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:49.396734 run osmo-stp_10.42.42.5(pid=21399): stdout: | (launched: 2022-12-14_12:21:47.780523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:49.518694 run osmo-stp_10.42.42.5(pid=21399): stderr: | [0;m[38;5;43m20221214122147954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122147954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122147955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122147955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122147955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122147956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122147956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:49.664151 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21399): Process ended prematurely: osmo-stp_10.42.42.5(pid=21399) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21399)] [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:21:49.673323 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:21:49.699683 run osmo-hlr_10.42.42.2(pid=21396): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21396)] 12:21:49.747913 run osmo-hlr_10.42.42.2(pid=21396): stdout: | (launched: 2022-12-14_12:21:46.468875) 12:21:49.797309 run osmo-hlr_10.42.42.2(pid=21396): stderr: | [0;m[1;31m20221214122146696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122146696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122146697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122146697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122146697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122146697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122146718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122146735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122146735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122146735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:49.866860 run osmo-msc_10.42.42.6(pid=21402): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21402)] 12:21:49.914337 run osmo-msc_10.42.42.6(pid=21402): stdout: | (launched: 2022-12-14_12:21:48.778280) 12:21:49.963741 run osmo-msc_10.42.42.6(pid=21402): stderr: | [0;m[38;5;43m20221214122149050 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122149050 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5d06522c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122149051 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122149051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122149051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122149051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122149053 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122149053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122149053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122149053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:50.013483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21395): Terminating (SIGTERM) 12:21:50.053321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21398): Terminating (SIGTERM) 12:21:50.093263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21401): Terminating (SIGTERM) 12:21:50.134401 --- ParallelTerminationStrategy: PID 21395 died... 12:21:50.153921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21395): Terminated: ok {rc=0} 12:21:50.198076 --- ParallelTerminationStrategy: PID 21398 died... 12:21:50.217092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21398): Terminated: ok {rc=0} 12:21:50.261134 --- ParallelTerminationStrategy: PID 21401 died... 12:21:50.279951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21401): Terminated: ok {rc=0} 12:21:50.364516 bus /sierra_3: Setting Powered False 12:21:51.459727 bus /sierra_3: Setting Powered False 12:21:52.574625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 12:21:53.824766 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:53.829546 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:21:53.859401 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:21:53.886877 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 12:21:53.974426 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:21:54.004761 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:21:54.032105 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 12:21:54.614016 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2404 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 12:21:54.621189 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:21:54.633088 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:21:54.679712 tst emergency_mo_mt_call.py: using LAC 40865 12:21:54.806616 tst emergency_mo_mt_call.py: using RAC 65 12:21:54.934398 tst emergency_mo_mt_call.py: using CellId 40865 12:21:55.065803 tst emergency_mo_mt_call.py: using BVCI 40866 12:21:55.183662 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:21:55.195268 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:21:55.206599 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:21:55.217770 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:21:55.229334 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:21:55.240491 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:21:55.356042 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:21:55.475698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:55.976743 run create_hlr_db(pid=21407): Launched 12:21:56.107736 bus /sierra_2: Setting Powered False 12:21:57.171222 run create_hlr_db(pid=21407): Terminated: ok {rc=0} 12:21:57.622718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21409): Launched 12:21:57.946028 run osmo-hlr_10.42.42.2(pid=21410): Launched 12:21:58.070288 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:58.630582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21412): Launched 12:21:58.953296 run osmo-stp_10.42.42.5(pid=21413): Launched 12:21:59.087873 tst emergency_mo_mt_call.py: using MSISDN 8677 12:21:59.253621 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:59.838635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21415): Launched 12:22:00.163733 run osmo-msc_10.42.42.6(pid=21416): Launched 12:22:00.344801 run osmo-stp_10.42.42.5(pid=21413): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21413)] 12:22:00.480125 run osmo-stp_10.42.42.5(pid=21413): stdout: | (launched: 2022-12-14_12:21:58.893099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:00.616140 run osmo-stp_10.42.42.5(pid=21413): stderr: | [0;m[38;5;43m20221214122159087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122159087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122159088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122159088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122159091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122159091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122159091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:00.751132 run osmo-stp_10.42.42.5(pid=21413): stdout: | (launched: 2022-12-14_12:21:58.893099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:00.903065 run osmo-stp_10.42.42.5(pid=21413): stderr: | [0;m[38;5;43m20221214122159087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122159087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122159088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122159088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122159091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122159091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122159091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:01.055193 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21413): Process ended prematurely: osmo-stp_10.42.42.5(pid=21413) [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21413)] [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 12:22:01.064770 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 12:22:01.092655 run osmo-hlr_10.42.42.2(pid=21410): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21410)] 12:22:01.145887 run osmo-hlr_10.42.42.2(pid=21410): stdout: | (launched: 2022-12-14_12:21:57.885782) 12:22:01.197967 run osmo-hlr_10.42.42.2(pid=21410): stderr: | [0;m[1;31m20221214122158086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122158086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122158086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122158086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122158086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122158086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122158099 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122158107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122158107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122158107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:01.274746 run osmo-msc_10.42.42.6(pid=21416): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21416)] 12:22:01.324521 run osmo-msc_10.42.42.6(pid=21416): stdout: | (launched: 2022-12-14_12:22:00.103638) 12:22:01.378822 run osmo-msc_10.42.42.6(pid=21416): stderr: | [0;m[38;5;43m20221214122200429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122200429 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f208846bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122200429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122200429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122200429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122200430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122200431 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122200432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122200432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122200432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:22:01.433355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21409): Terminating (SIGTERM) 12:22:01.475376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21412): Terminating (SIGTERM) 12:22:01.520481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21415): Terminating (SIGTERM) 12:22:01.566818 --- ParallelTerminationStrategy: PID 21409 died... 12:22:01.588823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21409): Terminated: ok {rc=0} 12:22:01.638259 --- ParallelTerminationStrategy: PID 21412 died... 12:22:01.658944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21412): Terminated: ok {rc=0} 12:22:01.706332 --- ParallelTerminationStrategy: PID 21415 died... 12:22:01.727382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21415): Terminated: ok {rc=0} 12:22:01.816872 bus /sierra_3: Setting Powered False 12:22:02.915167 bus /sierra_3: Setting Powered False 12:22:04.029690 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 12:22:05.115369 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:22:05.127163 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:22:05.174516 tst emergency_preemptive_call.py: using LAC 40866 12:22:05.294486 tst emergency_preemptive_call.py: using RAC 66 12:22:05.422461 tst emergency_preemptive_call.py: using CellId 40866 12:22:05.541364 tst emergency_preemptive_call.py: using BVCI 40867 12:22:05.650244 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:22:05.661255 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:22:05.672144 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:22:05.682886 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:22:05.694203 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:22:05.705212 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:05.822459 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:05.941464 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:06.058705 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:06.177117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:06.679344 run create_hlr_db(pid=21418): Launched 12:22:06.811710 bus /sierra_2: Setting Powered False 12:22:07.871510 run create_hlr_db(pid=21418): Terminated: ok {rc=0} 12:22:08.325913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21420): Launched 12:22:08.651112 run osmo-hlr_10.42.42.2(pid=21421): Launched 12:22:08.774843 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:09.330269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21423): Launched 12:22:09.653156 run osmo-stp_10.42.42.5(pid=21424): Launched 12:22:09.793585 tst emergency_preemptive_call.py: using MSISDN 8678 12:22:09.962290 run osmo-msc_10.42.42.6: Starting osmo-msc 12:22:10.542056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21426): Launched 12:22:10.864609 run osmo-msc_10.42.42.6(pid=21427): Launched 12:22:11.044861 run osmo-stp_10.42.42.5(pid=21424): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21424)] 12:22:11.180924 run osmo-stp_10.42.42.5(pid=21424): stdout: | (launched: 2022-12-14_12:22:09.592760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:11.317432 run osmo-stp_10.42.42.5(pid=21424): stderr: | [0;m[38;5;43m20221214122209787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122209787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122209788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122209788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122209788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122209789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122209789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:11.452319 run osmo-stp_10.42.42.5(pid=21424): stdout: | (launched: 2022-12-14_12:22:09.592760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:11.580320 run osmo-stp_10.42.42.5(pid=21424): stderr: | [0;m[38;5;43m20221214122209787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122209787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122209788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122209788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122209788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122209789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122209789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:11.733394 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21424): Process ended prematurely: osmo-stp_10.42.42.5(pid=21424) [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21424)] [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 12:22:11.742460 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 12:22:11.770014 run osmo-hlr_10.42.42.2(pid=21421): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21421)] 12:22:11.819964 run osmo-hlr_10.42.42.2(pid=21421): stdout: | (launched: 2022-12-14_12:22:08.591087) 12:22:11.871560 run osmo-hlr_10.42.42.2(pid=21421): stderr: | [0;m[1;31m20221214122208792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122208792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122208792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122208792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122208792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122208792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122208804 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122208813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122208813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122208813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:11.943999 run osmo-msc_10.42.42.6(pid=21427): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21427)] 12:22:11.993559 run osmo-msc_10.42.42.6(pid=21427): stdout: | (launched: 2022-12-14_12:22:10.804558) 12:22:12.045449 run osmo-msc_10.42.42.6(pid=21427): stderr: | [0;m[38;5;43m20221214122211127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122211127 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f72346fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122211128 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122211128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122211128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122211128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122211130 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122211130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122211131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122211131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:22:12.097216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21420): Terminating (SIGTERM) 12:22:12.138833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21423): Terminating (SIGTERM) 12:22:12.180406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21426): Terminating (SIGTERM) 12:22:12.222368 --- ParallelTerminationStrategy: PID 21420 died... 12:22:12.242335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21420): Terminated: ok {rc=0} 12:22:12.288420 --- ParallelTerminationStrategy: PID 21423 died... 12:22:12.308198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21423): Terminated: ok {rc=0} 12:22:12.354399 --- ParallelTerminationStrategy: PID 21426 died... 12:22:12.374017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21426): Terminated: ok {rc=0} 12:22:12.461798 bus /sierra_9: Setting Powered False 12:22:13.560203 bus /sierra_9: Setting Powered False 12:22:14.676332 bus /sierra_8: Setting Powered False 12:22:15.774520 bus /sierra_8: Setting Powered False 12:22:16.908472 bus /sierra_3: Setting Powered False 12:22:18.024662 bus /sierra_3: Setting Powered False 12:22:19.140924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 12:22:20.420256 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:22:20.425073 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:22:20.455116 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 12:22:20.494785 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 12:22:20.584196 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:22:20.614477 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 12:22:20.654023 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 12:22:21.249924 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 12:22:21.303720 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:21.315042 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:22:21.361332 tst cs_paging_gprs_active.py: using LAC 40867 12:22:21.490537 tst cs_paging_gprs_active.py: using RAC 67 12:22:21.619628 tst cs_paging_gprs_active.py: using CellId 40867 12:22:21.749080 tst cs_paging_gprs_active.py: using BVCI 40868 12:22:21.868180 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:21.879719 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:21.891096 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:21.902405 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:21.913449 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:21.924448 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:21.935733 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:21.946854 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:21.958087 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:22.076152 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:22.197663 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:22:22.421025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:22.753558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21432): Launched 12:22:23.043527 run iperf3-srv_10.42.42.10(pid=21433): Launched 12:22:23.168650 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:22:23.391623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:23.723773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21434): Launched 12:22:24.013124 run iperf3-srv_10.42.42.10(pid=21435): Launched 12:22:24.138373 tst cs_paging_gprs_active.py:38: start network... 12:22:24.360349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:24.871269 run create_hlr_db(pid=21436): Launched 12:22:25.006637 bus /sierra_2: Setting Powered False 12:22:26.068075 run create_hlr_db(pid=21436): Terminated: ok {rc=0} 12:22:26.530092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21438): Launched 12:22:26.860168 run osmo-hlr_10.42.42.2(pid=21439): Launched 12:22:26.986140 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:27.557520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21441): Launched 12:22:27.889145 run osmo-stp_10.42.42.5(pid=21442): Launched 12:22:28.015084 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:28.585549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21444): Launched 12:22:28.712617 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:28.991890 run patchelf(pid=21445): Launched 12:22:29.177281 run osmo-stp_10.42.42.5(pid=21442): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21442)] 12:22:29.316926 run osmo-stp_10.42.42.5(pid=21442): stdout: | (launched: 2022-12-14_12:22:27.827685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:29.458579 run osmo-stp_10.42.42.5(pid=21442): stderr: | [0;m[38;5;43m20221214122228026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122228026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122228026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122228026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122228027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122228027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122228027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:29.599844 run osmo-stp_10.42.42.5(pid=21442): stdout: | (launched: 2022-12-14_12:22:27.827685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:29.734630 run osmo-stp_10.42.42.5(pid=21442): stderr: | [0;m[38;5;43m20221214122228026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122228026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122228026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122228026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122228027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122228027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122228027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:29.894317 run patchelf(pid=21445): Terminating (SIGINT) 12:22:30.079042 run patchelf(pid=21445): Terminated: ok {rc=0} 12:22:30.211978 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21442): Process ended prematurely: osmo-stp_10.42.42.5(pid=21442) [trial-2404↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21442)] [trial-2404↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 12:22:30.222238 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 12:22:30.250819 run osmo-hlr_10.42.42.2(pid=21439): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21439)] 12:22:30.300677 run osmo-hlr_10.42.42.2(pid=21439): stdout: | (launched: 2022-12-14_12:22:26.799013) 12:22:30.352141 run osmo-hlr_10.42.42.2(pid=21439): stderr: | [0;m[1;31m20221214122227000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122227000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122227000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122227000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122227000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122227000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122227013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122227022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122227022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122227022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:30.403980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21432): Terminating (SIGTERM) 12:22:30.445757 run iperf3-srv_10.42.42.10(pid=21433): Terminating (SIGTERM) 12:22:30.488020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21434): Terminating (SIGTERM) 12:22:30.529885 run iperf3-srv_10.42.42.10(pid=21435): Terminating (SIGTERM) 12:22:30.571880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21438): Terminating (SIGTERM) 12:22:30.613886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21441): Terminating (SIGTERM) 12:22:30.655644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21444): Terminating (SIGTERM) 12:22:30.697783 --- ParallelTerminationStrategy: PID 21432 died... 12:22:30.717918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21432): Terminated: ok {rc=0} 12:22:30.763893 --- ParallelTerminationStrategy: PID 21433 died... 12:22:30.783183 run iperf3-srv_10.42.42.10(pid=21433): Terminated {rc=256} 12:22:30.829248 --- ParallelTerminationStrategy: PID 21434 died... 12:22:30.850766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21434): Terminated: ok {rc=0} 12:22:30.897422 --- ParallelTerminationStrategy: PID 21435 died... 12:22:30.919179 run iperf3-srv_10.42.42.10(pid=21435): Terminated {rc=256} 12:22:30.972714 --- ParallelTerminationStrategy: PID 21438 died... 12:22:30.993177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21438): Terminated: ok {rc=0} 12:22:31.040481 --- ParallelTerminationStrategy: PID 21441 died... 12:22:31.061846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21441): Terminated: ok {rc=0} 12:22:31.109238 --- ParallelTerminationStrategy: PID 21444 died... 12:22:31.129557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21444): Terminated: ok {rc=0} 12:22:31.223698 bus /gobi_0: Setting Powered False 12:22:32.336623 bus /gobi_0: Setting Powered False 12:22:33.451740 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 12:22:34.601463 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:34.613465 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:22:34.663587 tst iperf3.py: using LAC 40868 12:22:34.792425 tst iperf3.py: using RAC 68 12:22:34.920445 tst iperf3.py: using CellId 40868 12:22:35.048497 tst iperf3.py: using BVCI 40869 12:22:35.168242 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:35.179624 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:35.190739 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:35.201780 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:35.212686 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:35.223686 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:35.234880 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:35.245909 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:35.257010 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:35.373815 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:22:35.579689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:35.889418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21446): Launched 12:22:36.160581 run iperf3-srv_10.42.42.10(pid=21447): Launched 12:22:36.278452 tst iperf3.py:8: start network... 12:22:36.483785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:36.958332 run create_hlr_db(pid=21448): Launched 12:22:37.077150 bus /gobi_6: Setting Powered False 12:22:38.142128 run create_hlr_db(pid=21448): Terminated: ok {rc=0} 12:22:38.581382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21450): Launched 12:22:38.889210 run osmo-hlr_10.42.42.2(pid=21451): Launched 12:22:39.008380 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:39.554348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21453): Launched 12:22:39.862934 run osmo-stp_10.42.42.5(pid=21454): Launched 12:22:39.981164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:40.522879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21456): Launched 12:22:40.641627 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:40.901628 run patchelf(pid=21457): Launched 12:22:41.072223 run osmo-stp_10.42.42.5(pid=21454): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21454)] 12:22:41.202233 run osmo-stp_10.42.42.5(pid=21454): stdout: | (launched: 2022-12-14_12:22:39.805134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:41.334279 run osmo-stp_10.42.42.5(pid=21454): stderr: | [0;m[38;5;43m20221214122239978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122239978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122239978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122239978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122239979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122239979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122239979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:41.466474 run osmo-stp_10.42.42.5(pid=21454): stdout: | (launched: 2022-12-14_12:22:39.805134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:41.592556 run osmo-stp_10.42.42.5(pid=21454): stderr: | [0;m[38;5;43m20221214122239978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122239978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122239978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122239978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122239979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122239979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122239979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:41.741811 run patchelf(pid=21457): Terminating (SIGINT) 12:22:41.914578 run patchelf(pid=21457): Terminated: ok {rc=0} 12:22:42.038541 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21454): Process ended prematurely: osmo-stp_10.42.42.5(pid=21454) [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21454)] [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 12:22:42.048009 tst iperf3.py:8: Test FAILED (7.5 sec) 12:22:42.075091 run osmo-hlr_10.42.42.2(pid=21451): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21451)] 12:22:42.123076 run osmo-hlr_10.42.42.2(pid=21451): stdout: | (launched: 2022-12-14_12:22:38.831590) 12:22:42.172136 run osmo-hlr_10.42.42.2(pid=21451): stderr: | [0;m[1;31m20221214122239010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122239010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122239011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122239011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122239011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122239011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122239022 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122239030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122239030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122239030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:42.221599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21446): Terminating (SIGTERM) 12:22:42.261622 run iperf3-srv_10.42.42.10(pid=21447): Terminating (SIGTERM) 12:22:42.301458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21450): Terminating (SIGTERM) 12:22:42.341385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21453): Terminating (SIGTERM) 12:22:42.381515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21456): Terminating (SIGTERM) 12:22:42.422111 --- ParallelTerminationStrategy: PID 21446 died... 12:22:42.441802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21446): Terminated: ok {rc=0} 12:22:42.486269 --- ParallelTerminationStrategy: PID 21447 died... 12:22:42.505392 run iperf3-srv_10.42.42.10(pid=21447): Terminated {rc=256} 12:22:42.549658 --- ParallelTerminationStrategy: PID 21450 died... 12:22:42.568515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21450): Terminated: ok {rc=0} 12:22:42.613363 --- ParallelTerminationStrategy: PID 21453 died... 12:22:42.632204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21453): Terminated: ok {rc=0} 12:22:42.676928 --- ParallelTerminationStrategy: PID 21456 died... 12:22:42.696419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21456): Terminated: ok {rc=0} 12:22:42.782603 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 12:22:43.930895 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:43.942350 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:22:43.988134 tst iperf3m4.py: using LAC 40869 12:22:44.110105 tst iperf3m4.py: using RAC 69 12:22:44.229805 tst iperf3m4.py: using CellId 40869 12:22:44.350694 tst iperf3m4.py: using BVCI 40870 12:22:44.463161 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:44.474103 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:44.484726 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:44.495361 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:44.506290 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:44.517129 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:44.528162 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:44.538944 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:22:44.549979 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:44.667504 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:44.792614 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:44.910553 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:22:45.036266 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:22:45.259017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:45.592130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21458): Launched 12:22:45.885632 run iperf3-srv_10.42.42.10(pid=21459): Launched 12:22:46.028703 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:22:46.290500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:46.613732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21460): Launched 12:22:46.904125 run iperf3-srv_10.42.42.10(pid=21461): Launched 12:22:47.023934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:22:47.236920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:47.550005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21462): Launched 12:22:47.820822 run iperf3-srv_10.42.42.10(pid=21463): Launched 12:22:47.936224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:22:48.141560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:48.451047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21464): Launched 12:22:48.719820 run iperf3-srv_10.42.42.10(pid=21465): Launched 12:22:48.836075 tst iperf3m4.py:8: start network... 12:22:49.040659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:49.517456 run create_hlr_db(pid=21466): Launched 12:22:49.635348 bus /gobi_6: Setting Powered False 12:22:50.695947 run create_hlr_db(pid=21466): Terminated: ok {rc=0} 12:22:51.147036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21468): Launched 12:22:51.478366 run osmo-hlr_10.42.42.2(pid=21469): Launched 12:22:51.606598 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:52.284283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21471): Launched 12:22:52.607367 run osmo-stp_10.42.42.5(pid=21472): Launched 12:22:52.729373 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:53.287709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21474): Launched 12:22:53.412054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:53.686450 run patchelf(pid=21475): Launched 12:22:53.867044 run osmo-stp_10.42.42.5(pid=21472): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21472)] 12:22:54.003912 run osmo-stp_10.42.42.5(pid=21472): stdout: | (launched: 2022-12-14_12:22:52.547019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:54.142698 run osmo-stp_10.42.42.5(pid=21472): stderr: | [0;m[38;5;43m20221214122252740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122252741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122252741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122252741 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122252742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122252742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122252742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:54.280386 run osmo-stp_10.42.42.5(pid=21472): stdout: | (launched: 2022-12-14_12:22:52.547019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:54.412124 run osmo-stp_10.42.42.5(pid=21472): stderr: | [0;m[38;5;43m20221214122252740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122252741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122252741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122252741 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122252742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122252742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122252742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:54.568188 run patchelf(pid=21475): Terminating (SIGINT) 12:22:54.749302 run patchelf(pid=21475): Terminated: ok {rc=0} 12:22:54.879875 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21472): Process ended prematurely: osmo-stp_10.42.42.5(pid=21472) [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21472)] [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 12:22:54.890351 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:22:54.919136 run osmo-hlr_10.42.42.2(pid=21469): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21469)] 12:22:54.969294 run osmo-hlr_10.42.42.2(pid=21469): stdout: | (launched: 2022-12-14_12:22:51.416904) 12:22:55.021176 run osmo-hlr_10.42.42.2(pid=21469): stderr: | [0;m[1;31m20221214122251619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122251619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122251619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122251620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122251620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122251620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122251632 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122251640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122251640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122251640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:55.073333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21458): Terminating (SIGTERM) 12:22:55.115146 run iperf3-srv_10.42.42.10(pid=21459): Terminating (SIGTERM) 12:22:55.157122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21460): Terminating (SIGTERM) 12:22:55.198683 run iperf3-srv_10.42.42.10(pid=21461): Terminating (SIGTERM) 12:22:55.240067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21462): Terminating (SIGTERM) 12:22:55.281782 run iperf3-srv_10.42.42.10(pid=21463): Terminating (SIGTERM) 12:22:55.323090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21464): Terminating (SIGTERM) 12:22:55.365013 run iperf3-srv_10.42.42.10(pid=21465): Terminating (SIGTERM) 12:22:55.406460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21468): Terminating (SIGTERM) 12:22:55.449259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21471): Terminating (SIGTERM) 12:22:55.490899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21474): Terminating (SIGTERM) 12:22:55.532767 --- ParallelTerminationStrategy: PID 21458 died... 12:22:55.552799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21458): Terminated: ok {rc=0} 12:22:55.598702 --- ParallelTerminationStrategy: PID 21459 died... 12:22:55.618216 run iperf3-srv_10.42.42.10(pid=21459): Terminated {rc=256} 12:22:55.663980 --- ParallelTerminationStrategy: PID 21460 died... 12:22:55.683508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21460): Terminated: ok {rc=0} 12:22:55.729305 --- ParallelTerminationStrategy: PID 21461 died... 12:22:55.748572 run iperf3-srv_10.42.42.10(pid=21461): Terminated {rc=256} 12:22:55.794504 --- ParallelTerminationStrategy: PID 21462 died... 12:22:55.814055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21462): Terminated: ok {rc=0} 12:22:55.859589 --- ParallelTerminationStrategy: PID 21463 died... 12:22:55.879094 run iperf3-srv_10.42.42.10(pid=21463): Terminated {rc=256} 12:22:55.924803 --- ParallelTerminationStrategy: PID 21464 died... 12:22:55.944756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21464): Terminated: ok {rc=0} 12:22:55.990512 --- ParallelTerminationStrategy: PID 21465 died... 12:22:56.010197 run iperf3-srv_10.42.42.10(pid=21465): Terminated {rc=256} 12:22:56.055787 --- ParallelTerminationStrategy: PID 21468 died... 12:22:56.075744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21468): Terminated: ok {rc=0} 12:22:56.121411 --- ParallelTerminationStrategy: PID 21471 died... 12:22:56.140847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21471): Terminated: ok {rc=0} 12:22:56.186485 --- ParallelTerminationStrategy: PID 21474 died... 12:22:56.205890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21474): Terminated: ok {rc=0} 12:22:56.294003 bus /gobi_4: Setting Powered False 12:22:57.392561 bus /gobi_4: Setting Powered False 12:22:58.511018 bus /gobi_1: Setting Powered False 12:22:59.610877 bus /gobi_1: Setting Powered False 12:23:00.729101 bus /gobi_0: Setting Powered False 12:23:01.828047 bus /gobi_0: Setting Powered False 12:23:02.959138 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 12:23:04.062807 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:04.075199 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:23:04.121444 tst ping.py: using LAC 40870 12:23:04.246869 tst ping.py: using RAC 70 12:23:04.371510 tst ping.py: using CellId 40870 12:23:04.495278 tst ping.py: using BVCI 40871 12:23:04.609754 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:04.620862 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:04.632040 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:04.643097 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:04.654041 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:04.665055 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:04.676141 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:04.687133 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:23:04.801952 tst ping.py:19: start network... 12:23:04.999819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:05.456322 run create_hlr_db(pid=21477): Launched 12:23:05.568906 bus /gobi_6: Setting Powered False 12:23:06.628310 run create_hlr_db(pid=21477): Terminated: ok {rc=0} 12:23:07.063827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21479): Launched 12:23:07.381954 run osmo-hlr_10.42.42.2(pid=21480): Launched 12:23:07.504137 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:08.054743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21482): Launched 12:23:08.374274 run osmo-stp_10.42.42.5(pid=21483): Launched 12:23:08.496055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:09.044729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21485): Launched 12:23:09.166726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:09.435803 run patchelf(pid=21486): Launched 12:23:09.613935 run osmo-stp_10.42.42.5(pid=21483): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21483)] 12:23:09.748595 run osmo-stp_10.42.42.5(pid=21483): stdout: | (launched: 2022-12-14_12:23:08.315499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:09.885351 run osmo-stp_10.42.42.5(pid=21483): stderr: | [0;m[38;5;43m20221214122308510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122308510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122308510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122308510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122308511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122308511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122308511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:10.021935 run osmo-stp_10.42.42.5(pid=21483): stdout: | (launched: 2022-12-14_12:23:08.315499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:10.152371 run osmo-stp_10.42.42.5(pid=21483): stderr: | [0;m[38;5;43m20221214122308510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122308510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122308510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122308510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122308511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122308511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122308511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:10.306131 run patchelf(pid=21486): Terminating (SIGINT) 12:23:10.483789 run patchelf(pid=21486): Terminated: ok {rc=0} 12:23:10.612002 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21483): Process ended prematurely: osmo-stp_10.42.42.5(pid=21483) [trial-2404↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21483)] [trial-2404↪gprs:trx-lms-limenet-micro↪ping.py:22] 12:23:10.621821 tst ping.py:22: Test FAILED (6.6 sec) 12:23:10.649504 run osmo-hlr_10.42.42.2(pid=21480): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21480)] 12:23:10.699579 run osmo-hlr_10.42.42.2(pid=21480): stdout: | (launched: 2022-12-14_12:23:07.323283) 12:23:10.751387 run osmo-hlr_10.42.42.2(pid=21480): stderr: | [0;m[1;31m20221214122307522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122307522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122307523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122307523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122307523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122307523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122307534 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122307542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122307542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122307542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:10.803438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21479): Terminating (SIGTERM) 12:23:10.845438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21482): Terminating (SIGTERM) 12:23:10.887721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21485): Terminating (SIGTERM) 12:23:10.930020 --- ParallelTerminationStrategy: PID 21479 died... 12:23:10.950049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21479): Terminated: ok {rc=0} 12:23:10.996206 --- ParallelTerminationStrategy: PID 21482 died... 12:23:11.015886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21482): Terminated: ok {rc=0} 12:23:11.061770 --- ParallelTerminationStrategy: PID 21485 died... 12:23:11.081727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21485): Terminated: ok {rc=0} 12:23:11.170080 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 12:23:12.256472 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:12.268300 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:23:12.316110 tst ping_idle_ping.py: using LAC 40871 12:23:12.441410 tst ping_idle_ping.py: using RAC 71 12:23:12.566255 tst ping_idle_ping.py: using CellId 40871 12:23:12.692887 tst ping_idle_ping.py: using BVCI 40872 12:23:12.807871 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:12.819153 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:12.830321 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:12.841322 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:12.852175 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:12.863152 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:12.874415 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:23:12.885479 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:23:13.002890 tst ping_idle_ping.py:24: start network... 12:23:13.218434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:13.715121 run create_hlr_db(pid=21488): Launched 12:23:13.843713 bus /gobi_6: Setting Powered False 12:23:14.907498 run create_hlr_db(pid=21488): Terminated: ok {rc=0} 12:23:15.336226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21490): Launched 12:23:15.636789 run osmo-hlr_10.42.42.2(pid=21491): Launched 12:23:15.750563 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:16.409699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21493): Launched 12:23:16.720627 run osmo-stp_10.42.42.5(pid=21494): Launched 12:23:16.969512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:17.581861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21496): Launched 12:23:17.703415 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:17.972505 run patchelf(pid=21497): Launched 12:23:18.151277 run osmo-stp_10.42.42.5(pid=21494): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21494)] 12:23:18.286372 run osmo-stp_10.42.42.5(pid=21494): stdout: | (launched: 2022-12-14_12:23:16.664586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:18.423346 run osmo-stp_10.42.42.5(pid=21494): stderr: | [0;m[38;5;43m20221214122316884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122316884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122316885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122316886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122316886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122316886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122316886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:18.560115 run osmo-stp_10.42.42.5(pid=21494): stdout: | (launched: 2022-12-14_12:23:16.664586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:18.690511 run osmo-stp_10.42.42.5(pid=21494): stderr: | [0;m[38;5;43m20221214122316884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122316884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122316885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122316886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122316886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122316886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122316886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:18.844780 run patchelf(pid=21497): Terminating (SIGINT) 12:23:19.023506 run patchelf(pid=21497): Terminated: ok {rc=0} 12:23:19.152571 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21494): Process ended prematurely: osmo-stp_10.42.42.5(pid=21494) [trial-2404↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21494)] [trial-2404↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 12:23:19.162237 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 12:23:19.190028 run osmo-hlr_10.42.42.2(pid=21491): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21491)] 12:23:19.239945 run osmo-hlr_10.42.42.2(pid=21491): stdout: | (launched: 2022-12-14_12:23:15.579591) 12:23:19.291408 run osmo-hlr_10.42.42.2(pid=21491): stderr: | [0;m[1;31m20221214122315755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122315756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122315756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122315756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122315756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122315756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122315767 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122315776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122315776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122315776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:19.343732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21490): Terminating (SIGTERM) 12:23:19.385328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21493): Terminating (SIGTERM) 12:23:19.426894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21496): Terminating (SIGTERM) 12:23:19.468679 --- ParallelTerminationStrategy: PID 21490 died... 12:23:19.488511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21490): Terminated: ok {rc=0} 12:23:19.534415 --- ParallelTerminationStrategy: PID 21493 died... 12:23:19.554050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21493): Terminated: ok {rc=0} 12:23:19.599733 --- ParallelTerminationStrategy: PID 21496 died... 12:23:19.619238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21496): Terminated: ok {rc=0} 12:23:19.707711 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 12:23:21.007403 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:23:21.014403 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:23:21.044389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:23:21.084033 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:23:21.174183 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:23:21.204273 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:23:21.243477 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:23:21.834602 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:23:21.885801 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:21.896793 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:21.943953 tst cs_paging_gprs_active.py: using LAC 40872 12:23:22.063422 tst cs_paging_gprs_active.py: using RAC 72 12:23:22.181783 tst cs_paging_gprs_active.py: using CellId 40872 12:23:22.303184 tst cs_paging_gprs_active.py: using BVCI 40873 12:23:22.422711 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:22.434312 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:22.445598 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:22.456745 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:22.467965 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:22.479652 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:22.491136 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:22.502705 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:22.514287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:22.638304 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:22.755075 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:23:22.959328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:23.266620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21502): Launched 12:23:23.533032 run iperf3-srv_10.42.42.10(pid=21503): Launched 12:23:23.647543 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:23:23.850928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:24.157616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21504): Launched 12:23:24.423734 run iperf3-srv_10.42.42.10(pid=21505): Launched 12:23:24.537285 tst cs_paging_gprs_active.py:38: start network... 12:23:24.739680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:25.210882 run create_hlr_db(pid=21506): Launched 12:23:25.329946 bus /gobi_6: Setting Powered False 12:23:26.390510 run create_hlr_db(pid=21506): Terminated: ok {rc=0} 12:23:26.814959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21508): Launched 12:23:27.121239 run osmo-hlr_10.42.42.2(pid=21509): Launched 12:23:27.237589 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:27.775525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21511): Launched 12:23:28.079266 run osmo-stp_10.42.42.5(pid=21512): Launched 12:23:28.196724 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:28.723331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21514): Launched 12:23:28.841847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:29.100111 run patchelf(pid=21515): Launched 12:23:29.269374 run osmo-stp_10.42.42.5(pid=21512): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21512)] 12:23:29.398109 run osmo-stp_10.42.42.5(pid=21512): stdout: | (launched: 2022-12-14_12:23:28.022657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:29.528837 run osmo-stp_10.42.42.5(pid=21512): stderr: | [0;m[38;5;43m20221214122328195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122328195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122328196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122328196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122328196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122328197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122328197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:29.659468 run osmo-stp_10.42.42.5(pid=21512): stdout: | (launched: 2022-12-14_12:23:28.022657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:29.784688 run osmo-stp_10.42.42.5(pid=21512): stderr: | [0;m[38;5;43m20221214122328195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122328195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122328196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122328196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122328196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122328197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122328197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:29.932277 run patchelf(pid=21515): Terminating (SIGINT) 12:23:30.103771 run patchelf(pid=21515): Terminated: ok {rc=0} 12:23:30.227445 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21512): Process ended prematurely: osmo-stp_10.42.42.5(pid=21512) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21512)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:23:30.237092 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 12:23:30.264123 run osmo-hlr_10.42.42.2(pid=21509): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21509)] 12:23:30.312330 run osmo-hlr_10.42.42.2(pid=21509): stdout: | (launched: 2022-12-14_12:23:27.064155) 12:23:30.361667 run osmo-hlr_10.42.42.2(pid=21509): stderr: | [0;m[1;31m20221214122327243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122327243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122327243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122327243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122327244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122327244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122327255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122327264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122327264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122327264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:30.411563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21502): Terminating (SIGTERM) 12:23:30.451733 run iperf3-srv_10.42.42.10(pid=21503): Terminating (SIGTERM) 12:23:30.491745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21504): Terminating (SIGTERM) 12:23:30.531744 run iperf3-srv_10.42.42.10(pid=21505): Terminating (SIGTERM) 12:23:30.571603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21508): Terminating (SIGTERM) 12:23:30.611710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21511): Terminating (SIGTERM) 12:23:30.651529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21514): Terminating (SIGTERM) 12:23:30.691755 --- ParallelTerminationStrategy: PID 21502 died... 12:23:30.711147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21502): Terminated: ok {rc=0} 12:23:30.755456 --- ParallelTerminationStrategy: PID 21503 died... 12:23:30.774325 run iperf3-srv_10.42.42.10(pid=21503): Terminated {rc=256} 12:23:30.818135 --- ParallelTerminationStrategy: PID 21504 died... 12:23:30.847134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21504): Terminated: ok {rc=0} 12:23:30.913634 --- ParallelTerminationStrategy: PID 21505 died... 12:23:30.934141 run iperf3-srv_10.42.42.10(pid=21505): Terminated {rc=256} 12:23:30.982610 --- ParallelTerminationStrategy: PID 21508 died... 12:23:31.004505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21508): Terminated: ok {rc=0} 12:23:31.052916 --- ParallelTerminationStrategy: PID 21511 died... 12:23:31.074467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21511): Terminated: ok {rc=0} 12:23:31.123480 --- ParallelTerminationStrategy: PID 21514 died... 12:23:31.144896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21514): Terminated: ok {rc=0} 12:23:31.237853 bus /gobi_0: Setting Powered False 12:23:32.336908 bus /gobi_0: Setting Powered False 12:23:33.452392 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:23:34.599673 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:34.611457 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:34.658297 tst iperf3.py: using LAC 40873 12:23:34.777383 tst iperf3.py: using RAC 73 12:23:34.895005 tst iperf3.py: using CellId 40873 12:23:35.016007 tst iperf3.py: using BVCI 40874 12:23:35.127472 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.138590 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.149602 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.160281 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.171327 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.182478 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.193799 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.204788 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.216083 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:35.337276 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:23:35.555689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:35.882149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21516): Launched 12:23:36.165782 run iperf3-srv_10.42.42.10(pid=21517): Launched 12:23:36.286402 tst iperf3.py:8: start network... 12:23:36.503981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:37.006164 run create_hlr_db(pid=21518): Launched 12:23:37.138695 bus /gobi_6: Setting Powered False 12:23:38.201506 run create_hlr_db(pid=21518): Terminated: ok {rc=0} 12:23:38.636790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21520): Launched 12:23:38.941021 run osmo-hlr_10.42.42.2(pid=21521): Launched 12:23:39.056638 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:39.583334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21523): Launched 12:23:39.888449 run osmo-stp_10.42.42.5(pid=21524): Launched 12:23:40.005470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:40.527823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21526): Launched 12:23:40.643188 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:40.899651 run patchelf(pid=21527): Launched 12:23:41.069200 run osmo-stp_10.42.42.5(pid=21524): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21524)] 12:23:41.197983 run osmo-stp_10.42.42.5(pid=21524): stdout: | (launched: 2022-12-14_12:23:39.832095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:41.327675 run osmo-stp_10.42.42.5(pid=21524): stderr: | [0;m[38;5;43m20221214122340004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122340004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122340004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122340005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122340005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122340005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122340006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:41.457456 run osmo-stp_10.42.42.5(pid=21524): stdout: | (launched: 2022-12-14_12:23:39.832095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:41.581326 run osmo-stp_10.42.42.5(pid=21524): stderr: | [0;m[38;5;43m20221214122340004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122340004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122340004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122340005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122340005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122340005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122340006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:41.728273 run patchelf(pid=21527): Terminating (SIGINT) 12:23:41.898868 run patchelf(pid=21527): Terminated: ok {rc=0} 12:23:42.021254 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21524): Process ended prematurely: osmo-stp_10.42.42.5(pid=21524) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21524)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 12:23:42.030748 tst iperf3.py:8: Test FAILED (7.5 sec) 12:23:42.057710 run osmo-hlr_10.42.42.2(pid=21521): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21521)] 12:23:42.105929 run osmo-hlr_10.42.42.2(pid=21521): stdout: | (launched: 2022-12-14_12:23:38.884465) 12:23:42.156015 run osmo-hlr_10.42.42.2(pid=21521): stderr: | [0;m[1;31m20221214122339060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122339060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122339060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122339060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122339061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122339061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122339073 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122339081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122339081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122339081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:42.205955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21516): Terminating (SIGTERM) 12:23:42.246150 run iperf3-srv_10.42.42.10(pid=21517): Terminating (SIGTERM) 12:23:42.286159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21520): Terminating (SIGTERM) 12:23:42.326860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21523): Terminating (SIGTERM) 12:23:42.366744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21526): Terminating (SIGTERM) 12:23:42.407225 --- ParallelTerminationStrategy: PID 21516 died... 12:23:42.426556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21516): Terminated: ok {rc=0} 12:23:42.470729 --- ParallelTerminationStrategy: PID 21517 died... 12:23:42.489531 run iperf3-srv_10.42.42.10(pid=21517): Terminated {rc=256} 12:23:42.533265 --- ParallelTerminationStrategy: PID 21520 died... 12:23:42.551883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21520): Terminated: ok {rc=0} 12:23:42.595767 --- ParallelTerminationStrategy: PID 21523 died... 12:23:42.614528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21523): Terminated: ok {rc=0} 12:23:42.658397 --- ParallelTerminationStrategy: PID 21526 died... 12:23:42.677224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21526): Terminated: ok {rc=0} 12:23:42.760899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:23:43.910213 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:43.922618 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:43.971910 tst iperf3m4.py: using LAC 40874 12:23:44.103972 tst iperf3m4.py: using RAC 74 12:23:44.230275 tst iperf3m4.py: using CellId 40874 12:23:44.350267 tst iperf3m4.py: using BVCI 40875 12:23:44.462181 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:44.473309 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:44.484346 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:44.495378 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:44.507182 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:44.518891 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:44.530713 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:44.542318 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:44.554201 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:44.684433 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:44.805714 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:44.923715 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:45.039330 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:23:45.242624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:45.547649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21528): Launched 12:23:45.812578 run iperf3-srv_10.42.42.10(pid=21529): Launched 12:23:45.957709 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:23:46.179070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:46.501609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21530): Launched 12:23:46.777892 run iperf3-srv_10.42.42.10(pid=21531): Launched 12:23:46.909897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:23:47.120113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:47.431617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21532): Launched 12:23:47.697073 run iperf3-srv_10.42.42.10(pid=21533): Launched 12:23:47.810653 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:23:48.013653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:48.319141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21534): Launched 12:23:48.586375 run iperf3-srv_10.42.42.10(pid=21535): Launched 12:23:48.701156 tst iperf3m4.py:8: start network... 12:23:48.903404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:49.374704 run create_hlr_db(pid=21536): Launched 12:23:49.491508 bus /gobi_6: Setting Powered False 12:23:50.552028 run create_hlr_db(pid=21536): Terminated: ok {rc=0} 12:23:50.998494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21538): Launched 12:23:51.324780 run osmo-hlr_10.42.42.2(pid=21539): Launched 12:23:51.450256 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:52.011768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21541): Launched 12:23:52.337592 run osmo-stp_10.42.42.5(pid=21542): Launched 12:23:52.461723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:53.023324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21544): Launched 12:23:53.148819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:53.423642 run patchelf(pid=21545): Launched 12:23:53.605344 run osmo-stp_10.42.42.5(pid=21542): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21542)] 12:23:53.743113 run osmo-stp_10.42.42.5(pid=21542): stdout: | (launched: 2022-12-14_12:23:52.277162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:53.882081 run osmo-stp_10.42.42.5(pid=21542): stderr: | [0;m[38;5;43m20221214122352472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122352473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122352473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122352473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122352474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122352474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122352474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:54.022335 run osmo-stp_10.42.42.5(pid=21542): stdout: | (launched: 2022-12-14_12:23:52.277162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:54.155877 run osmo-stp_10.42.42.5(pid=21542): stderr: | [0;m[38;5;43m20221214122352472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122352473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122352473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122352473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122352474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122352474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122352474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:54.313354 run patchelf(pid=21545): Terminating (SIGINT) 12:23:54.495533 run patchelf(pid=21545): Terminated: ok {rc=0} 12:23:54.626675 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21542): Process ended prematurely: osmo-stp_10.42.42.5(pid=21542) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21542)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 12:23:54.637029 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:23:54.665543 run osmo-hlr_10.42.42.2(pid=21539): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21539)] 12:23:54.715476 run osmo-hlr_10.42.42.2(pid=21539): stdout: | (launched: 2022-12-14_12:23:51.264669) 12:23:54.767324 run osmo-hlr_10.42.42.2(pid=21539): stderr: | [0;m[1;31m20221214122351466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122351466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122351466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122351466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122351466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122351466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122351479 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122351487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122351487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122351487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:54.819282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21528): Terminating (SIGTERM) 12:23:54.861147 run iperf3-srv_10.42.42.10(pid=21529): Terminating (SIGTERM) 12:23:54.903039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21530): Terminating (SIGTERM) 12:23:54.945012 run iperf3-srv_10.42.42.10(pid=21531): Terminating (SIGTERM) 12:23:54.986838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21532): Terminating (SIGTERM) 12:23:55.028573 run iperf3-srv_10.42.42.10(pid=21533): Terminating (SIGTERM) 12:23:55.070355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21534): Terminating (SIGTERM) 12:23:55.112597 run iperf3-srv_10.42.42.10(pid=21535): Terminating (SIGTERM) 12:23:55.154420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21538): Terminating (SIGTERM) 12:23:55.196206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21541): Terminating (SIGTERM) 12:23:55.238044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21544): Terminating (SIGTERM) 12:23:55.280007 --- ParallelTerminationStrategy: PID 21528 died... 12:23:55.299987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21528): Terminated: ok {rc=0} 12:23:55.346060 --- ParallelTerminationStrategy: PID 21529 died... 12:23:55.365379 run iperf3-srv_10.42.42.10(pid=21529): Terminated {rc=256} 12:23:55.410964 --- ParallelTerminationStrategy: PID 21530 died... 12:23:55.430397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21530): Terminated: ok {rc=0} 12:23:55.476166 --- ParallelTerminationStrategy: PID 21531 died... 12:23:55.495541 run iperf3-srv_10.42.42.10(pid=21531): Terminated {rc=256} 12:23:55.541311 --- ParallelTerminationStrategy: PID 21532 died... 12:23:55.560658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21532): Terminated: ok {rc=0} 12:23:55.606296 --- ParallelTerminationStrategy: PID 21533 died... 12:23:55.625700 run iperf3-srv_10.42.42.10(pid=21533): Terminated {rc=256} 12:23:55.671123 --- ParallelTerminationStrategy: PID 21534 died... 12:23:55.690538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21534): Terminated: ok {rc=0} 12:23:55.736087 --- ParallelTerminationStrategy: PID 21535 died... 12:23:55.755490 run iperf3-srv_10.42.42.10(pid=21535): Terminated {rc=256} 12:23:55.801222 --- ParallelTerminationStrategy: PID 21538 died... 12:23:55.820539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21538): Terminated: ok {rc=0} 12:23:55.866280 --- ParallelTerminationStrategy: PID 21541 died... 12:23:55.885704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21541): Terminated: ok {rc=0} 12:23:55.931578 --- ParallelTerminationStrategy: PID 21544 died... 12:23:55.951242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21544): Terminated: ok {rc=0} 12:23:56.039787 bus /gobi_4: Setting Powered False 12:23:57.139881 bus /gobi_4: Setting Powered False 12:23:58.256631 bus /gobi_1: Setting Powered False 12:23:59.355258 bus /gobi_1: Setting Powered False 12:24:00.471009 bus /gobi_0: Setting Powered False 12:24:01.568557 bus /gobi_0: Setting Powered False 12:24:02.715204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 12:24:03.840730 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:03.853975 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:24:03.900382 tst ping.py: using LAC 40875 12:24:04.026161 tst ping.py: using RAC 75 12:24:04.152354 tst ping.py: using CellId 40875 12:24:04.279549 tst ping.py: using BVCI 40876 12:24:04.400063 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:04.412761 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:04.426335 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:04.438763 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:04.451238 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:04.463638 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:04.476399 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:04.488939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:24:04.613737 tst ping.py:19: start network... 12:24:04.833679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:05.340503 run create_hlr_db(pid=21815): Launched 12:24:05.508750 bus /gobi_6: Setting Powered False 12:24:06.569674 run create_hlr_db(pid=21815): Terminated: ok {rc=0} 12:24:06.996435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21819): Launched 12:24:07.314938 run osmo-hlr_10.42.42.2(pid=21820): Launched 12:24:07.548384 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:08.243772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21822): Launched 12:24:08.565059 run osmo-stp_10.42.42.5(pid=21823): Launched 12:24:08.796019 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:09.501982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21825): Launched 12:24:09.633285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:09.895753 run patchelf(pid=21826): Launched 12:24:10.084102 run osmo-stp_10.42.42.5(pid=21823): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21823)] 12:24:10.217214 run osmo-stp_10.42.42.5(pid=21823): stdout: | (launched: 2022-12-14_12:24:08.507662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:10.353819 run osmo-stp_10.42.42.5(pid=21823): stderr: | [0;m[38;5;43m20221214122408844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122408844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122408844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122408844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122408847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122408847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122408847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:10.488727 run osmo-stp_10.42.42.5(pid=21823): stdout: | (launched: 2022-12-14_12:24:08.507662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:10.616432 run osmo-stp_10.42.42.5(pid=21823): stderr: | [0;m[38;5;43m20221214122408844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122408844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122408844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122408844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122408847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122408847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122408847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:10.768045 run patchelf(pid=21826): Terminating (SIGINT) 12:24:10.943089 run patchelf(pid=21826): Terminated: ok {rc=0} 12:24:11.069946 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21823): Process ended prematurely: osmo-stp_10.42.42.5(pid=21823) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21823)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 12:24:11.080130 tst ping.py:22: Test FAILED (7.2 sec) 12:24:11.108694 run osmo-hlr_10.42.42.2(pid=21820): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21820)] 12:24:11.162124 run osmo-hlr_10.42.42.2(pid=21820): stdout: | (launched: 2022-12-14_12:24:07.259043) 12:24:11.215504 run osmo-hlr_10.42.42.2(pid=21820): stderr: | [0;m[1;31m20221214122407594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122407594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122407594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122407594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122407594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122407594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122407615 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122407626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122407626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122407626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:11.270632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21819): Terminating (SIGTERM) 12:24:11.313192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21822): Terminating (SIGTERM) 12:24:11.360678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21825): Terminating (SIGTERM) 12:24:11.406843 --- ParallelTerminationStrategy: PID 21819 died... 12:24:11.429412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21819): Terminated: ok {rc=0} 12:24:11.478661 --- ParallelTerminationStrategy: PID 21822 died... 12:24:11.499874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21822): Terminated: ok {rc=0} 12:24:11.547122 --- ParallelTerminationStrategy: PID 21825 died... 12:24:11.568402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21825): Terminated: ok {rc=0} 12:24:11.660340 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:24:12.751787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:12.764517 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:24:12.814150 tst ping_idle_ping.py: using LAC 40876 12:24:12.935490 tst ping_idle_ping.py: using RAC 76 12:24:13.059026 tst ping_idle_ping.py: using CellId 40876 12:24:13.181126 tst ping_idle_ping.py: using BVCI 40877 12:24:13.293782 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:13.306186 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:13.318602 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:13.330472 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:13.344460 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:13.357738 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:13.370983 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:24:13.383496 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:24:13.507836 tst ping_idle_ping.py:24: start network... 12:24:13.715478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:14.199506 run create_hlr_db(pid=21827): Launched 12:24:14.361131 bus /gobi_6: Setting Powered False 12:24:15.421754 run create_hlr_db(pid=21827): Terminated: ok {rc=0} 12:24:15.858421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21829): Launched 12:24:16.221549 run osmo-hlr_10.42.42.2(pid=21830): Launched 12:24:16.441744 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:17.306875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21832): Launched 12:24:17.663437 run osmo-stp_10.42.42.5(pid=21833): Launched 12:24:17.952476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:18.693699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21835): Launched 12:24:18.821296 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:19.093764 run patchelf(pid=21836): Launched 12:24:19.285676 run osmo-stp_10.42.42.5(pid=21833): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21833)] 12:24:19.422734 run osmo-stp_10.42.42.5(pid=21833): stdout: | (launched: 2022-12-14_12:24:17.596920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:19.562617 run osmo-stp_10.42.42.5(pid=21833): stderr: | [0;m[38;5;43m20221214122417977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122417977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122417977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122417978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122417980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122417980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122417981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:19.703013 run osmo-stp_10.42.42.5(pid=21833): stdout: | (launched: 2022-12-14_12:24:17.596920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:19.836133 run osmo-stp_10.42.42.5(pid=21833): stderr: | [0;m[38;5;43m20221214122417977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122417977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122417977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122417978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122417980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122417980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122417981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:19.994204 run patchelf(pid=21836): Terminating (SIGINT) 12:24:20.177398 run patchelf(pid=21836): Terminated: ok {rc=0} 12:24:20.308634 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21833): Process ended prematurely: osmo-stp_10.42.42.5(pid=21833) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21833)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 12:24:20.319538 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 12:24:20.349063 run osmo-hlr_10.42.42.2(pid=21830): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21830)] 12:24:20.400864 run osmo-hlr_10.42.42.2(pid=21830): stdout: | (launched: 2022-12-14_12:24:16.155072) 12:24:20.454248 run osmo-hlr_10.42.42.2(pid=21830): stderr: | [0;m[1;31m20221214122416567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122416567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122416567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122416567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122416567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122416567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122416584 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122416593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122416593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122416593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:20.508029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21829): Terminating (SIGTERM) 12:24:20.551105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21832): Terminating (SIGTERM) 12:24:20.594817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21835): Terminating (SIGTERM) 12:24:20.640410 --- ParallelTerminationStrategy: PID 21829 died... 12:24:20.661471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21829): Terminated: ok {rc=0} 12:24:20.710317 --- ParallelTerminationStrategy: PID 21832 died... 12:24:20.731416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21832): Terminated: ok {rc=0} 12:24:20.779248 --- ParallelTerminationStrategy: PID 21835 died... 12:24:20.800001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21835): Terminated: ok {rc=0} 12:24:20.890820 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:24:22.205591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:24:22.213334 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:24:22.245429 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:24:22.286479 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:24:22.377953 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:24:22.409371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:24:22.451137 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:24:23.046853 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:24:23.101312 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:23.113408 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:23.182763 tst cs_paging_gprs_active.py: using LAC 40877 12:24:23.311006 tst cs_paging_gprs_active.py: using RAC 77 12:24:23.441300 tst cs_paging_gprs_active.py: using CellId 40877 12:24:23.565093 tst cs_paging_gprs_active.py: using BVCI 40878 12:24:23.682056 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:23.694408 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:23.706626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:23.718672 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:23.731866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:23.745479 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:23.758520 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:23.771111 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:23.784195 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:23.911158 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:24.033687 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:24:24.247659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:24.573029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21840): Launched 12:24:24.867366 run iperf3-srv_10.42.42.10(pid=21842): Launched 12:24:24.981791 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:24:25.185701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:25.493583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21843): Launched 12:24:25.760839 run iperf3-srv_10.42.42.10(pid=21844): Launched 12:24:25.874797 tst cs_paging_gprs_active.py:38: start network... 12:24:26.077633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:26.548819 run create_hlr_db(pid=21845): Launched 12:24:26.682837 bus /gobi_6: Setting Powered False 12:24:27.746606 run create_hlr_db(pid=21845): Terminated: ok {rc=0} 12:24:28.201423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21847): Launched 12:24:28.530461 run osmo-hlr_10.42.42.2(pid=21848): Launched 12:24:28.656175 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:29.218049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21850): Launched 12:24:29.545952 run osmo-stp_10.42.42.5(pid=21851): Launched 12:24:29.671362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:30.236821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21853): Launched 12:24:30.362533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:30.639253 run patchelf(pid=21854): Launched 12:24:30.820580 run osmo-stp_10.42.42.5(pid=21851): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21851)] 12:24:30.977987 run osmo-stp_10.42.42.5(pid=21851): stdout: | (launched: 2022-12-14_12:24:29.485630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:31.129869 run osmo-stp_10.42.42.5(pid=21851): stderr: | [0;m[38;5;43m20221214122429683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122429683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122429683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122429684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122429684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122429684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122429684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:31.272035 run osmo-stp_10.42.42.5(pid=21851): stdout: | (launched: 2022-12-14_12:24:29.485630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:31.408927 run osmo-stp_10.42.42.5(pid=21851): stderr: | [0;m[38;5;43m20221214122429683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122429683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122429683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122429684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122429684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122429684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122429684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:31.569828 run patchelf(pid=21854): Terminating (SIGINT) 12:24:31.755901 run patchelf(pid=21854): Terminated: ok {rc=0} 12:24:31.889973 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21851): Process ended prematurely: osmo-stp_10.42.42.5(pid=21851) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21851)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:24:31.901099 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:24:31.931472 run osmo-hlr_10.42.42.2(pid=21848): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21848)] 12:24:31.983091 run osmo-hlr_10.42.42.2(pid=21848): stdout: | (launched: 2022-12-14_12:24:28.469412) 12:24:32.036117 run osmo-hlr_10.42.42.2(pid=21848): stderr: | [0;m[1;31m20221214122428671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122428671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122428671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122428671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122428671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122428671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122428712 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122428720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122428720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122428720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:32.089698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21840): Terminating (SIGTERM) 12:24:32.133044 run iperf3-srv_10.42.42.10(pid=21842): Terminating (SIGTERM) 12:24:32.177097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21843): Terminating (SIGTERM) 12:24:32.220727 run iperf3-srv_10.42.42.10(pid=21844): Terminating (SIGTERM) 12:24:32.263555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21847): Terminating (SIGTERM) 12:24:32.305562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21850): Terminating (SIGTERM) 12:24:32.347479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21853): Terminating (SIGTERM) 12:24:32.389605 --- ParallelTerminationStrategy: PID 21840 died... 12:24:32.409754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21840): Terminated: ok {rc=0} 12:24:32.456244 --- ParallelTerminationStrategy: PID 21842 died... 12:24:32.475973 run iperf3-srv_10.42.42.10(pid=21842): Terminated {rc=256} 12:24:32.522147 --- ParallelTerminationStrategy: PID 21843 died... 12:24:32.541778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21843): Terminated: ok {rc=0} 12:24:32.587748 --- ParallelTerminationStrategy: PID 21844 died... 12:24:32.607747 run iperf3-srv_10.42.42.10(pid=21844): Terminated {rc=256} 12:24:32.653930 --- ParallelTerminationStrategy: PID 21847 died... 12:24:32.673651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21847): Terminated: ok {rc=0} 12:24:32.719741 --- ParallelTerminationStrategy: PID 21850 died... 12:24:32.739357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21850): Terminated: ok {rc=0} 12:24:32.785731 --- ParallelTerminationStrategy: PID 21853 died... 12:24:32.805358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21853): Terminated: ok {rc=0} 12:24:32.893279 bus /gobi_0: Setting Powered False 12:24:33.993645 bus /gobi_0: Setting Powered False 12:24:35.109820 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:24:36.256008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.268019 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:36.336316 tst iperf3.py: using LAC 40878 12:24:36.472601 tst iperf3.py: using RAC 78 12:24:36.588117 tst iperf3.py: using CellId 40878 12:24:36.704290 tst iperf3.py: using BVCI 40879 12:24:36.811043 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.822081 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.832856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.843609 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.854554 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.865554 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.876653 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.887646 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.898815 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:37.016220 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:24:37.214832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:37.511767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21855): Launched 12:24:37.769729 run iperf3-srv_10.42.42.10(pid=21856): Launched 12:24:37.880699 tst iperf3.py:8: start network... 12:24:38.077839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:38.534385 run create_hlr_db(pid=21857): Launched 12:24:38.646133 bus /gobi_6: Setting Powered False 12:24:39.705224 run create_hlr_db(pid=21857): Terminated: ok {rc=0} 12:24:40.138380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21859): Launched 12:24:40.456083 run osmo-hlr_10.42.42.2(pid=21860): Launched 12:24:40.577988 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:41.129481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21862): Launched 12:24:41.445357 run osmo-stp_10.42.42.5(pid=21863): Launched 12:24:41.566543 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:42.112833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21865): Launched 12:24:42.234291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:42.501616 run patchelf(pid=21866): Launched 12:24:42.677025 run osmo-stp_10.42.42.5(pid=21863): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21863)] 12:24:42.810797 run osmo-stp_10.42.42.5(pid=21863): stdout: | (launched: 2022-12-14_12:24:41.387263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:42.946638 run osmo-stp_10.42.42.5(pid=21863): stderr: | [0;m[38;5;43m20221214122441575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122441575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122441576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122441576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122441576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122441576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122441577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:43.082307 run osmo-stp_10.42.42.5(pid=21863): stdout: | (launched: 2022-12-14_12:24:41.387263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:43.212487 run osmo-stp_10.42.42.5(pid=21863): stderr: | [0;m[38;5;43m20221214122441575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122441575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122441576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122441576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122441576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122441576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122441577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:43.366193 run patchelf(pid=21866): Terminating (SIGINT) 12:24:43.543698 run patchelf(pid=21866): Terminated: ok {rc=0} 12:24:43.671801 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21863): Process ended prematurely: osmo-stp_10.42.42.5(pid=21863) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21863)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 12:24:43.681836 tst iperf3.py:8: Test FAILED (7.5 sec) 12:24:43.709783 run osmo-hlr_10.42.42.2(pid=21860): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21860)] 12:24:43.758903 run osmo-hlr_10.42.42.2(pid=21860): stdout: | (launched: 2022-12-14_12:24:40.398198) 12:24:43.809658 run osmo-hlr_10.42.42.2(pid=21860): stderr: | [0;m[1;31m20221214122440592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122440592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122440592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122440592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122440592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122440592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122440605 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122440614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122440614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122440615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:43.860745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21855): Terminating (SIGTERM) 12:24:43.901939 run iperf3-srv_10.42.42.10(pid=21856): Terminating (SIGTERM) 12:24:43.942963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21859): Terminating (SIGTERM) 12:24:43.984463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21862): Terminating (SIGTERM) 12:24:44.026072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21865): Terminating (SIGTERM) 12:24:44.067354 --- ParallelTerminationStrategy: PID 21855 died... 12:24:44.087059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21855): Terminated: ok {rc=0} 12:24:44.132824 --- ParallelTerminationStrategy: PID 21856 died... 12:24:44.152544 run iperf3-srv_10.42.42.10(pid=21856): Terminated {rc=256} 12:24:44.198090 --- ParallelTerminationStrategy: PID 21859 died... 12:24:44.217404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21859): Terminated: ok {rc=0} 12:24:44.263048 --- ParallelTerminationStrategy: PID 21862 died... 12:24:44.282334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21862): Terminated: ok {rc=0} 12:24:44.327924 --- ParallelTerminationStrategy: PID 21865 died... 12:24:44.347252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21865): Terminated: ok {rc=0} 12:24:44.432764 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:24:45.575395 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:45.587010 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:45.653247 tst iperf3m4.py: using LAC 40879 12:24:45.769145 tst iperf3m4.py: using RAC 79 12:24:45.899448 tst iperf3m4.py: using CellId 40879 12:24:46.027268 tst iperf3m4.py: using BVCI 40880 12:24:46.138474 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:46.150547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:46.162505 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:46.174356 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:46.187437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:46.200338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:46.213503 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:46.227296 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:46.240051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:46.358878 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:46.477685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:46.622802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:46.756474 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:24:46.998668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:47.332220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21867): Launched 12:24:47.592604 run iperf3-srv_10.42.42.10(pid=21868): Launched 12:24:47.703634 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:24:47.900767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:48.197967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21869): Launched 12:24:48.456397 run iperf3-srv_10.42.42.10(pid=21870): Launched 12:24:48.567397 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:24:48.764421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:49.061195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21871): Launched 12:24:49.319282 run iperf3-srv_10.42.42.10(pid=21872): Launched 12:24:49.430380 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:24:49.627028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:49.923499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21873): Launched 12:24:50.181214 run iperf3-srv_10.42.42.10(pid=21874): Launched 12:24:50.291944 tst iperf3m4.py:8: start network... 12:24:50.488767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:50.944930 run create_hlr_db(pid=21875): Launched 12:24:51.058528 bus /gobi_6: Setting Powered False 12:24:52.118585 run create_hlr_db(pid=21875): Terminated: ok {rc=0} 12:24:52.531449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Launched 12:24:52.826309 run osmo-hlr_10.42.42.2(pid=21878): Launched 12:24:52.937616 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:53.458049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Launched 12:24:53.753130 run osmo-stp_10.42.42.5(pid=21881): Launched 12:24:53.865630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:54.375227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21883): Launched 12:24:54.488510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:54.738119 run patchelf(pid=21884): Launched 12:24:54.904202 run osmo-stp_10.42.42.5(pid=21881): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] 12:24:55.030762 run osmo-stp_10.42.42.5(pid=21881): stdout: | (launched: 2022-12-14_12:24:53.698319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:55.159198 run osmo-stp_10.42.42.5(pid=21881): stderr: | [0;m[38;5;43m20221214122453864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122453864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122453865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122453865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122453865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122453866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122453866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:55.287749 run osmo-stp_10.42.42.5(pid=21881): stdout: | (launched: 2022-12-14_12:24:53.698319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:55.409688 run osmo-stp_10.42.42.5(pid=21881): stderr: | [0;m[38;5;43m20221214122453864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122453864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122453865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122453865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122453865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122453866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122453866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:55.554425 run patchelf(pid=21884): Terminating (SIGINT) 12:24:55.721942 run patchelf(pid=21884): Terminated: ok {rc=0} 12:24:55.842699 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21881): Process ended prematurely: osmo-stp_10.42.42.5(pid=21881) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:24:55.852024 tst iperf3m4.py:8: Test FAILED (10.3 sec) 12:24:55.878908 run osmo-hlr_10.42.42.2(pid=21878): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21878)] 12:24:55.926481 run osmo-hlr_10.42.42.2(pid=21878): stdout: | (launched: 2022-12-14_12:24:52.771235) 12:24:55.975174 run osmo-hlr_10.42.42.2(pid=21878): stderr: | [0;m[1;31m20221214122452941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122452941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122452941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122452941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122452941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122452941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122452954 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122452962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122452963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122452963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:56.025273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21867): Terminating (SIGTERM) 12:24:56.064850 run iperf3-srv_10.42.42.10(pid=21868): Terminating (SIGTERM) 12:24:56.104404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21869): Terminating (SIGTERM) 12:24:56.144079 run iperf3-srv_10.42.42.10(pid=21870): Terminating (SIGTERM) 12:24:56.183519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21871): Terminating (SIGTERM) 12:24:56.222845 run iperf3-srv_10.42.42.10(pid=21872): Terminating (SIGTERM) 12:24:56.262141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21873): Terminating (SIGTERM) 12:24:56.301569 run iperf3-srv_10.42.42.10(pid=21874): Terminating (SIGTERM) 12:24:56.340936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Terminating (SIGTERM) 12:24:56.380348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Terminating (SIGTERM) 12:24:56.419997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21883): Terminating (SIGTERM) 12:24:56.459699 --- ParallelTerminationStrategy: PID 21867 died... 12:24:56.478902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21867): Terminated: ok {rc=0} 12:24:56.522558 --- ParallelTerminationStrategy: PID 21868 died... 12:24:56.541197 run iperf3-srv_10.42.42.10(pid=21868): Terminated {rc=256} 12:24:56.584615 --- ParallelTerminationStrategy: PID 21869 died... 12:24:56.603302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21869): Terminated: ok {rc=0} 12:24:56.646677 --- ParallelTerminationStrategy: PID 21870 died... 12:24:56.665210 run iperf3-srv_10.42.42.10(pid=21870): Terminated {rc=256} 12:24:56.708518 --- ParallelTerminationStrategy: PID 21871 died... 12:24:56.727287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21871): Terminated: ok {rc=0} 12:24:56.770659 --- ParallelTerminationStrategy: PID 21872 died... 12:24:56.789297 run iperf3-srv_10.42.42.10(pid=21872): Terminated {rc=256} 12:24:56.832853 --- ParallelTerminationStrategy: PID 21873 died... 12:24:56.851971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21873): Terminated: ok {rc=0} 12:24:56.895604 --- ParallelTerminationStrategy: PID 21874 died... 12:24:56.914315 run iperf3-srv_10.42.42.10(pid=21874): Terminated {rc=256} 12:24:56.957721 --- ParallelTerminationStrategy: PID 21877 died... 12:24:56.976334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Terminated: ok {rc=0} 12:24:57.019731 --- ParallelTerminationStrategy: PID 21880 died... 12:24:57.038470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Terminated: ok {rc=0} 12:24:57.082077 --- ParallelTerminationStrategy: PID 21883 died... 12:24:57.100857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21883): Terminated: ok {rc=0} 12:24:57.186304 bus /gobi_4: Setting Powered False 12:24:58.284175 bus /gobi_4: Setting Powered False 12:24:59.399071 bus /gobi_1: Setting Powered False 12:25:00.499170 bus /gobi_1: Setting Powered False 12:25:01.635866 bus /gobi_0: Setting Powered False 12:25:02.735806 bus /gobi_0: Setting Powered False 12:25:03.853011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:25:04.954670 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:04.966897 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:25:05.033710 tst ping.py: using LAC 40880 12:25:05.157035 tst ping.py: using RAC 80 12:25:05.281207 tst ping.py: using CellId 40880 12:25:05.404256 tst ping.py: using BVCI 40881 12:25:05.517648 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:05.529400 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:05.540850 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:05.552447 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:05.564017 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:05.575679 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:05.587440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:05.599068 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:25:05.714274 tst ping.py:19: start network... 12:25:05.909597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:06.361666 run create_hlr_db(pid=21888): Launched 12:25:06.492516 bus /gobi_6: Setting Powered False 12:25:07.554456 run create_hlr_db(pid=21888): Terminated: ok {rc=0} 12:25:07.990264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21890): Launched 12:25:08.302027 run osmo-hlr_10.42.42.2(pid=21891): Launched 12:25:08.420110 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:08.959728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21893): Launched 12:25:09.271254 run osmo-stp_10.42.42.5(pid=21894): Launched 12:25:09.393157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:09.896793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21896): Launched 12:25:10.008457 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:10.254331 run patchelf(pid=21897): Launched 12:25:10.416243 run osmo-stp_10.42.42.5(pid=21894): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21894)] 12:25:10.551380 run osmo-stp_10.42.42.5(pid=21894): stdout: | (launched: 2022-12-14_12:25:09.214131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:10.686360 run osmo-stp_10.42.42.5(pid=21894): stderr: | [0;m[38;5;43m20221214122509404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122509404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122509404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122509405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122509405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122509405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122509405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:10.820835 run osmo-stp_10.42.42.5(pid=21894): stdout: | (launched: 2022-12-14_12:25:09.214131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:10.949025 run osmo-stp_10.42.42.5(pid=21894): stderr: | [0;m[38;5;43m20221214122509404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122509404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122509404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122509405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122509405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122509405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122509405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:11.100927 run patchelf(pid=21897): Terminating (SIGINT) 12:25:11.277377 run patchelf(pid=21897): Terminated: ok {rc=0} 12:25:11.404510 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21894): Process ended prematurely: osmo-stp_10.42.42.5(pid=21894) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21894)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 12:25:11.414453 tst ping.py:22: Test FAILED (6.5 sec) 12:25:11.442210 run osmo-hlr_10.42.42.2(pid=21891): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21891)] 12:25:11.491969 run osmo-hlr_10.42.42.2(pid=21891): stdout: | (launched: 2022-12-14_12:25:08.244891) 12:25:11.543143 run osmo-hlr_10.42.42.2(pid=21891): stderr: | [0;m[1;31m20221214122508440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122508440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122508440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122508440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122508441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122508441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122508453 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122508461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122508462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122508462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:11.594625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21890): Terminating (SIGTERM) 12:25:11.636385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21893): Terminating (SIGTERM) 12:25:11.677981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21896): Terminating (SIGTERM) 12:25:11.719707 --- ParallelTerminationStrategy: PID 21890 died... 12:25:11.739883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21890): Terminated: ok {rc=0} 12:25:11.786007 --- ParallelTerminationStrategy: PID 21893 died... 12:25:11.805638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21893): Terminated: ok {rc=0} 12:25:11.851384 --- ParallelTerminationStrategy: PID 21896 died... 12:25:11.871059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21896): Terminated: ok {rc=0} 12:25:11.958828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:25:13.045327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:13.057626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:25:13.126736 tst ping_idle_ping.py: using LAC 40881 12:25:13.242451 tst ping_idle_ping.py: using RAC 81 12:25:13.358758 tst ping_idle_ping.py: using CellId 40881 12:25:13.476497 tst ping_idle_ping.py: using BVCI 40882 12:25:13.591836 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:13.603475 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:13.614977 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:13.626552 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:13.638599 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:13.650295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:13.662053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:25:13.673747 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:25:13.788236 tst ping_idle_ping.py:24: start network... 12:25:13.983459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:14.437209 run create_hlr_db(pid=21898): Launched 12:25:14.548836 bus /gobi_6: Setting Powered False 12:25:15.607035 run create_hlr_db(pid=21898): Terminated: ok {rc=0} 12:25:16.063642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21900): Launched 12:25:16.400585 run osmo-hlr_10.42.42.2(pid=21901): Launched 12:25:16.644457 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:17.274805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21903): Launched 12:25:17.586867 run osmo-stp_10.42.42.5(pid=21904): Launched 12:25:17.705476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:18.245131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21906): Launched 12:25:18.364280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:18.629693 run patchelf(pid=21907): Launched 12:25:18.803729 run osmo-stp_10.42.42.5(pid=21904): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21904)] 12:25:18.936442 run osmo-stp_10.42.42.5(pid=21904): stdout: | (launched: 2022-12-14_12:25:17.529780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:19.071195 run osmo-stp_10.42.42.5(pid=21904): stderr: | [0;m[38;5;43m20221214122517718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122517718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122517719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122517719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122517719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122517720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122517720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:19.206621 run osmo-stp_10.42.42.5(pid=21904): stdout: | (launched: 2022-12-14_12:25:17.529780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:19.335266 run osmo-stp_10.42.42.5(pid=21904): stderr: | [0;m[38;5;43m20221214122517718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122517718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122517719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122517719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122517719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122517720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122517720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:19.487443 run patchelf(pid=21907): Terminating (SIGINT) 12:25:19.663617 run patchelf(pid=21907): Terminated: ok {rc=0} 12:25:19.790380 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21904): Process ended prematurely: osmo-stp_10.42.42.5(pid=21904) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21904)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:25:19.799860 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:25:19.827474 run osmo-hlr_10.42.42.2(pid=21901): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21901)] 12:25:19.876805 run osmo-hlr_10.42.42.2(pid=21901): stdout: | (launched: 2022-12-14_12:25:16.334703) 12:25:19.927790 run osmo-hlr_10.42.42.2(pid=21901): stderr: | [0;m[1;31m20221214122516649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122516650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122516650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122516650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122516650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122516650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122516666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122516682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122516682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122516683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:19.979495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21900): Terminating (SIGTERM) 12:25:20.020753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21903): Terminating (SIGTERM) 12:25:20.062743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21906): Terminating (SIGTERM) 12:25:20.104491 --- ParallelTerminationStrategy: PID 21900 died... 12:25:20.124339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21900): Terminated: ok {rc=0} 12:25:20.170128 --- ParallelTerminationStrategy: PID 21903 died... 12:25:20.189428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21903): Terminated: ok {rc=0} 12:25:20.234728 --- ParallelTerminationStrategy: PID 21906 died... 12:25:20.254063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21906): Terminated: ok {rc=0} 12:25:20.341433 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:25:21.642288 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:25:21.648521 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:25:21.678009 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:25:21.716838 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:25:21.806899 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:25:21.836934 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:25:21.875083 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:25:22.471881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:25:22.522881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:22.534364 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:25:22.602305 tst cs_paging_gprs_active.py: using LAC 40882 12:25:22.726572 tst cs_paging_gprs_active.py: using RAC 82 12:25:22.850841 tst cs_paging_gprs_active.py: using CellId 40882 12:25:22.974861 tst cs_paging_gprs_active.py: using BVCI 40883 12:25:23.089893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:23.101510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:23.112735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:23.124025 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:23.135706 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:23.147114 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:23.158557 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:23.169812 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:23.181249 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:23.298314 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:23.413709 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:25:23.613855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:23.911819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21914): Launched 12:25:24.171762 run iperf3-srv_10.42.42.10(pid=21915): Launched 12:25:24.283247 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:25:24.482253 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:24.782248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21916): Launched 12:25:25.042306 run iperf3-srv_10.42.42.10(pid=21917): Launched 12:25:25.154392 tst cs_paging_gprs_active.py:38: start network... 12:25:25.353280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:25.814437 run create_hlr_db(pid=21918): Launched 12:25:25.928779 bus /gobi_6: Setting Powered False 12:25:26.988714 run create_hlr_db(pid=21918): Terminated: ok {rc=0} 12:25:27.426563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21920): Launched 12:25:27.747140 run osmo-hlr_10.42.42.2(pid=21921): Launched 12:25:27.868500 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:28.417613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21923): Launched 12:25:28.736937 run osmo-stp_10.42.42.5(pid=21924): Launched 12:25:28.858384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:29.408475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21926): Launched 12:25:29.530859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:29.806610 run patchelf(pid=21927): Launched 12:25:29.984036 run osmo-stp_10.42.42.5(pid=21924): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21924)] 12:25:30.118971 run osmo-stp_10.42.42.5(pid=21924): stdout: | (launched: 2022-12-14_12:25:28.678383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:30.256260 run osmo-stp_10.42.42.5(pid=21924): stderr: | [0;m[38;5;43m20221214122528866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122528866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122528867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122528867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122528868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122528868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122528868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:30.393489 run osmo-stp_10.42.42.5(pid=21924): stdout: | (launched: 2022-12-14_12:25:28.678383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:30.524641 run osmo-stp_10.42.42.5(pid=21924): stderr: | [0;m[38;5;43m20221214122528866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122528866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122528867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122528867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122528868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122528868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122528868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:30.679704 run patchelf(pid=21927): Terminating (SIGINT) 12:25:30.860425 run patchelf(pid=21927): Terminated: ok {rc=0} 12:25:31.002683 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21924): Process ended prematurely: osmo-stp_10.42.42.5(pid=21924) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21924)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:25:31.013385 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 12:25:31.042514 run osmo-hlr_10.42.42.2(pid=21921): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21921)] 12:25:31.095322 run osmo-hlr_10.42.42.2(pid=21921): stdout: | (launched: 2022-12-14_12:25:27.688560) 12:25:31.148227 run osmo-hlr_10.42.42.2(pid=21921): stderr: | [0;m[1;31m20221214122527883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122527883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122527883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122527883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122527883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122527883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122527896 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122527906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122527906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122527906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:31.200811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21914): Terminating (SIGTERM) 12:25:31.243837 run iperf3-srv_10.42.42.10(pid=21915): Terminating (SIGTERM) 12:25:31.289181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21916): Terminating (SIGTERM) 12:25:31.332152 run iperf3-srv_10.42.42.10(pid=21917): Terminating (SIGTERM) 12:25:31.377152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21920): Terminating (SIGTERM) 12:25:31.419287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21923): Terminating (SIGTERM) 12:25:31.461731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21926): Terminating (SIGTERM) 12:25:31.504322 --- ParallelTerminationStrategy: PID 21914 died... 12:25:31.525386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21914): Terminated: ok {rc=0} 12:25:31.571531 --- ParallelTerminationStrategy: PID 21915 died... 12:25:31.591333 run iperf3-srv_10.42.42.10(pid=21915): Terminated {rc=256} 12:25:31.637426 --- ParallelTerminationStrategy: PID 21916 died... 12:25:31.657176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21916): Terminated: ok {rc=0} 12:25:31.703206 --- ParallelTerminationStrategy: PID 21917 died... 12:25:31.723033 run iperf3-srv_10.42.42.10(pid=21917): Terminated {rc=256} 12:25:31.769198 --- ParallelTerminationStrategy: PID 21920 died... 12:25:31.789033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21920): Terminated: ok {rc=0} 12:25:31.835225 --- ParallelTerminationStrategy: PID 21923 died... 12:25:31.855145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21923): Terminated: ok {rc=0} 12:25:31.901757 --- ParallelTerminationStrategy: PID 21926 died... 12:25:31.921594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21926): Terminated: ok {rc=0} 12:25:32.009325 bus /gobi_0: Setting Powered False 12:25:33.107688 bus /gobi_0: Setting Powered False 12:25:34.222857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:25:35.368109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:35.380154 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:25:35.447773 tst iperf3.py: using LAC 40883 12:25:35.569246 tst iperf3.py: using RAC 83 12:25:35.685714 tst iperf3.py: using CellId 40883 12:25:35.801362 tst iperf3.py: using BVCI 40884 12:25:35.908660 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:35.919782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:35.930656 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:35.941525 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:35.952586 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:35.963735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:35.974866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:35.985983 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:35.997290 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:36.112356 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:25:36.311138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:36.609962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21928): Launched 12:25:36.869153 run iperf3-srv_10.42.42.10(pid=21929): Launched 12:25:36.979783 tst iperf3.py:8: start network... 12:25:37.177332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:37.636671 run create_hlr_db(pid=21930): Launched 12:25:37.750413 bus /gobi_6: Setting Powered False 12:25:38.809479 run create_hlr_db(pid=21930): Terminated: ok {rc=0} 12:25:39.225478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21932): Launched 12:25:39.522802 run osmo-hlr_10.42.42.2(pid=21933): Launched 12:25:39.635622 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:40.161350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21935): Launched 12:25:40.459921 run osmo-stp_10.42.42.5(pid=21936): Launched 12:25:40.574394 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:41.088644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21938): Launched 12:25:41.202691 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:41.453883 run patchelf(pid=21939): Launched 12:25:41.618634 run osmo-stp_10.42.42.5(pid=21936): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21936)] 12:25:41.744774 run osmo-stp_10.42.42.5(pid=21936): stdout: | (launched: 2022-12-14_12:25:40.404689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:41.873331 run osmo-stp_10.42.42.5(pid=21936): stderr: | [0;m[38;5;43m20221214122540569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122540569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122540569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122540570 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122540570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122540570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122540570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:42.002168 run osmo-stp_10.42.42.5(pid=21936): stdout: | (launched: 2022-12-14_12:25:40.404689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:42.124734 run osmo-stp_10.42.42.5(pid=21936): stderr: | [0;m[38;5;43m20221214122540569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122540569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122540569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122540570 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122540570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122540570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122540570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:42.269498 run patchelf(pid=21939): Terminating (SIGINT) 12:25:42.437257 run patchelf(pid=21939): Terminated: ok {rc=0} 12:25:42.558173 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21936): Process ended prematurely: osmo-stp_10.42.42.5(pid=21936) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21936)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 12:25:42.567568 tst iperf3.py:8: Test FAILED (7.2 sec) 12:25:42.594372 run osmo-hlr_10.42.42.2(pid=21933): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21933)] 12:25:42.641925 run osmo-hlr_10.42.42.2(pid=21933): stdout: | (launched: 2022-12-14_12:25:39.468065) 12:25:42.691015 run osmo-hlr_10.42.42.2(pid=21933): stderr: | [0;m[1;31m20221214122539641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122539641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122539641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122539641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122539641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122539641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122539653 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122539661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122539661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122539661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:42.740791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21928): Terminating (SIGTERM) 12:25:42.780840 run iperf3-srv_10.42.42.10(pid=21929): Terminating (SIGTERM) 12:25:42.820840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21932): Terminating (SIGTERM) 12:25:42.860632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21935): Terminating (SIGTERM) 12:25:42.900016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21938): Terminating (SIGTERM) 12:25:42.939585 --- ParallelTerminationStrategy: PID 21928 died... 12:25:42.958766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21928): Terminated: ok {rc=0} 12:25:43.002673 --- ParallelTerminationStrategy: PID 21929 died... 12:25:43.021358 run iperf3-srv_10.42.42.10(pid=21929): Terminated {rc=256} 12:25:43.064860 --- ParallelTerminationStrategy: PID 21932 died... 12:25:43.083986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21932): Terminated: ok {rc=0} 12:25:43.127505 --- ParallelTerminationStrategy: PID 21935 died... 12:25:43.146221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21935): Terminated: ok {rc=0} 12:25:43.189723 --- ParallelTerminationStrategy: PID 21938 died... 12:25:43.208387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21938): Terminated: ok {rc=0} 12:25:43.291285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:25:44.432334 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:44.444242 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:25:44.511755 tst iperf3m4.py: using LAC 40884 12:25:44.628646 tst iperf3m4.py: using RAC 84 12:25:44.744613 tst iperf3m4.py: using CellId 40884 12:25:44.861386 tst iperf3m4.py: using BVCI 40885 12:25:44.968798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:44.980047 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:44.991431 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:45.002471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:45.013828 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:45.025141 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:45.036440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:45.047668 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:25:45.059123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:45.178902 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:45.300236 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:45.419018 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:25:45.540027 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:25:45.755012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:46.101806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21940): Launched 12:25:46.391695 run iperf3-srv_10.42.42.10(pid=21941): Launched 12:25:46.527146 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:25:46.747104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:47.073852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21942): Launched 12:25:47.363114 run iperf3-srv_10.42.42.10(pid=21943): Launched 12:25:47.481644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:25:47.695087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:48.014246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21944): Launched 12:25:48.290903 run iperf3-srv_10.42.42.10(pid=21945): Launched 12:25:48.408935 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:25:48.622376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:25:48.941614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21946): Launched 12:25:49.218349 run iperf3-srv_10.42.42.10(pid=21947): Launched 12:25:49.336884 tst iperf3m4.py:8: start network... 12:25:49.550058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:50.042586 run create_hlr_db(pid=21948): Launched 12:25:50.171935 bus /gobi_6: Setting Powered False 12:25:51.235470 run create_hlr_db(pid=21948): Terminated: ok {rc=0} 12:25:51.661636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21950): Launched 12:25:51.960835 run osmo-hlr_10.42.42.2(pid=21951): Launched 12:25:52.081991 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:52.606155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21953): Launched 12:25:52.904557 run osmo-stp_10.42.42.5(pid=21954): Launched 12:25:53.017531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:25:53.531328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21956): Launched 12:25:53.645770 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:25:53.897697 run patchelf(pid=21957): Launched 12:25:54.063950 run osmo-stp_10.42.42.5(pid=21954): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21954)] 12:25:54.190962 run osmo-stp_10.42.42.5(pid=21954): stdout: | (launched: 2022-12-14_12:25:52.849369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:54.319706 run osmo-stp_10.42.42.5(pid=21954): stderr: | [0;m[38;5;43m20221214122553016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122553016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122553016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122553017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122553017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122553017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122553017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:54.451683 run osmo-stp_10.42.42.5(pid=21954): stdout: | (launched: 2022-12-14_12:25:52.849369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:54.583161 run osmo-stp_10.42.42.5(pid=21954): stderr: | [0;m[38;5;43m20221214122553016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122553016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122553016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122553017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122553017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122553017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122553017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:54.738547 run patchelf(pid=21957): Terminating (SIGINT) 12:25:54.918258 run patchelf(pid=21957): Terminated: ok {rc=0} 12:25:55.047730 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21954): Process ended prematurely: osmo-stp_10.42.42.5(pid=21954) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21954)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:25:55.058236 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:25:55.086905 run osmo-hlr_10.42.42.2(pid=21951): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21951)] 12:25:55.136433 run osmo-hlr_10.42.42.2(pid=21951): stdout: | (launched: 2022-12-14_12:25:51.905705) 12:25:55.188094 run osmo-hlr_10.42.42.2(pid=21951): stderr: | [0;m[1;31m20221214122552081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122552082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122552094 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122552102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122552102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122552103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:55.239564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21940): Terminating (SIGTERM) 12:25:55.281142 run iperf3-srv_10.42.42.10(pid=21941): Terminating (SIGTERM) 12:25:55.322919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21942): Terminating (SIGTERM) 12:25:55.364593 run iperf3-srv_10.42.42.10(pid=21943): Terminating (SIGTERM) 12:25:55.406017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21944): Terminating (SIGTERM) 12:25:55.447462 run iperf3-srv_10.42.42.10(pid=21945): Terminating (SIGTERM) 12:25:55.489209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21946): Terminating (SIGTERM) 12:25:55.530623 run iperf3-srv_10.42.42.10(pid=21947): Terminating (SIGTERM) 12:25:55.572307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21950): Terminating (SIGTERM) 12:25:55.613659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21953): Terminating (SIGTERM) 12:25:55.655302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21956): Terminating (SIGTERM) 12:25:55.697378 --- ParallelTerminationStrategy: PID 21940 died... 12:25:55.717235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21940): Terminated: ok {rc=0} 12:25:55.762800 --- ParallelTerminationStrategy: PID 21941 died... 12:25:55.781946 run iperf3-srv_10.42.42.10(pid=21941): Terminated {rc=256} 12:25:55.826910 --- ParallelTerminationStrategy: PID 21942 died... 12:25:55.846579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21942): Terminated: ok {rc=0} 12:25:55.891764 --- ParallelTerminationStrategy: PID 21943 died... 12:25:55.910913 run iperf3-srv_10.42.42.10(pid=21943): Terminated {rc=256} 12:25:55.956197 --- ParallelTerminationStrategy: PID 21944 died... 12:25:55.975617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21944): Terminated: ok {rc=0} 12:25:56.020853 --- ParallelTerminationStrategy: PID 21945 died... 12:25:56.040643 run iperf3-srv_10.42.42.10(pid=21945): Terminated {rc=256} 12:25:56.085826 --- ParallelTerminationStrategy: PID 21946 died... 12:25:56.105290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21946): Terminated: ok {rc=0} 12:25:56.150886 --- ParallelTerminationStrategy: PID 21947 died... 12:25:56.170213 run iperf3-srv_10.42.42.10(pid=21947): Terminated {rc=256} 12:25:56.215522 --- ParallelTerminationStrategy: PID 21950 died... 12:25:56.234897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21950): Terminated: ok {rc=0} 12:25:56.280510 --- ParallelTerminationStrategy: PID 21953 died... 12:25:56.299986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21953): Terminated: ok {rc=0} 12:25:56.345559 --- ParallelTerminationStrategy: PID 21956 died... 12:25:56.364775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21956): Terminated: ok {rc=0} 12:25:56.452064 bus /gobi_4: Setting Powered False 12:25:57.549828 bus /gobi_4: Setting Powered False 12:25:58.666770 bus /gobi_1: Setting Powered False 12:25:59.764766 bus /gobi_1: Setting Powered False 12:26:00.894816 bus /gobi_0: Setting Powered False 12:26:02.007178 bus /gobi_0: Setting Powered False 12:26:03.140354 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:26:04.243290 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:04.255102 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:26:04.322348 tst ping.py: using LAC 40885 12:26:04.439609 tst ping.py: using RAC 85 12:26:04.555756 tst ping.py: using CellId 40885 12:26:04.681382 tst ping.py: using BVCI 40886 12:26:04.795669 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:04.807358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:04.819326 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:04.830862 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:04.842952 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:04.855110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:04.867315 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:04.879525 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:26:05.000150 tst ping.py:19: start network... 12:26:05.212342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:05.696566 run create_hlr_db(pid=21958): Launched 12:26:05.822791 bus /gobi_6: Setting Powered False 12:26:06.885127 run create_hlr_db(pid=21958): Terminated: ok {rc=0} 12:26:07.305607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21960): Launched 12:26:07.599699 run osmo-hlr_10.42.42.2(pid=21961): Launched 12:26:07.712029 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:08.218404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21963): Launched 12:26:08.511311 run osmo-stp_10.42.42.5(pid=21964): Launched 12:26:08.622534 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:09.130411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21966): Launched 12:26:09.242655 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:09.490917 run patchelf(pid=21967): Launched 12:26:09.654703 run osmo-stp_10.42.42.5(pid=21964): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21964)] 12:26:09.779634 run osmo-stp_10.42.42.5(pid=21964): stdout: | (launched: 2022-12-14_12:26:08.456302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:09.906239 run osmo-stp_10.42.42.5(pid=21964): stderr: | [0;m[38;5;43m20221214122608626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122608626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122608627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122608628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122608628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122608628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122608628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:10.032701 run osmo-stp_10.42.42.5(pid=21964): stdout: | (launched: 2022-12-14_12:26:08.456302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:10.153197 run osmo-stp_10.42.42.5(pid=21964): stderr: | [0;m[38;5;43m20221214122608626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122608626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122608627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122608628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122608628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122608628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122608628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:10.296142 run patchelf(pid=21967): Terminating (SIGINT) 12:26:10.461217 run patchelf(pid=21967): Terminated: ok {rc=0} 12:26:10.579687 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21964): Process ended prematurely: osmo-stp_10.42.42.5(pid=21964) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21964)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 12:26:10.588529 tst ping.py:22: Test FAILED (6.3 sec) 12:26:10.615358 run osmo-hlr_10.42.42.2(pid=21961): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21961)] 12:26:10.662935 run osmo-hlr_10.42.42.2(pid=21961): stdout: | (launched: 2022-12-14_12:26:07.544661) 12:26:10.712190 run osmo-hlr_10.42.42.2(pid=21961): stderr: | [0;m[1;31m20221214122607721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122607721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122607721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122607721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122607721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122607722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122607732 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122607741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122607741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122607741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:10.762083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21960): Terminating (SIGTERM) 12:26:10.802030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21963): Terminating (SIGTERM) 12:26:10.841807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21966): Terminating (SIGTERM) 12:26:10.881965 --- ParallelTerminationStrategy: PID 21960 died... 12:26:10.901571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21960): Terminated: ok {rc=0} 12:26:10.945568 --- ParallelTerminationStrategy: PID 21963 died... 12:26:10.964311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21963): Terminated: ok {rc=0} 12:26:11.008390 --- ParallelTerminationStrategy: PID 21966 died... 12:26:11.027617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21966): Terminated: ok {rc=0} 12:26:11.112846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:26:12.200560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:12.212582 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:26:12.280645 tst ping_idle_ping.py: using LAC 40886 12:26:12.396054 tst ping_idle_ping.py: using RAC 86 12:26:12.515130 tst ping_idle_ping.py: using CellId 40886 12:26:12.629646 tst ping_idle_ping.py: using BVCI 40887 12:26:12.744787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:12.756614 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:12.768198 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:12.779789 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:12.791311 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:12.802988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:12.814715 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:26:12.826171 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:26:12.947937 tst ping_idle_ping.py:24: start network... 12:26:13.161860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:13.653312 run create_hlr_db(pid=21968): Launched 12:26:13.781478 bus /gobi_6: Setting Powered False 12:26:14.844385 run create_hlr_db(pid=21968): Terminated: ok {rc=0} 12:26:15.269235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21970): Launched 12:26:15.565258 run osmo-hlr_10.42.42.2(pid=21971): Launched 12:26:15.679060 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:16.245887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21973): Launched 12:26:16.572198 run osmo-stp_10.42.42.5(pid=21974): Launched 12:26:16.818076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:17.445927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21976): Launched 12:26:17.567468 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:17.835142 run patchelf(pid=21977): Launched 12:26:18.009398 run osmo-stp_10.42.42.5(pid=21974): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21974)] 12:26:18.143106 run osmo-stp_10.42.42.5(pid=21974): stdout: | (launched: 2022-12-14_12:26:16.511641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:18.278787 run osmo-stp_10.42.42.5(pid=21974): stderr: | [0;m[38;5;43m20221214122616807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122616807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122616808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122616808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122616809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122616809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122616809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:18.413878 run osmo-stp_10.42.42.5(pid=21974): stdout: | (launched: 2022-12-14_12:26:16.511641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:18.542528 run osmo-stp_10.42.42.5(pid=21974): stderr: | [0;m[38;5;43m20221214122616807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122616807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122616808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122616808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122616809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122616809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122616809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:18.695362 run patchelf(pid=21977): Terminating (SIGINT) 12:26:18.871780 run patchelf(pid=21977): Terminated: ok {rc=0} 12:26:18.998596 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21974): Process ended prematurely: osmo-stp_10.42.42.5(pid=21974) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21974)] [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:26:19.008134 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:26:19.036072 run osmo-hlr_10.42.42.2(pid=21971): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21971)] 12:26:19.085871 run osmo-hlr_10.42.42.2(pid=21971): stdout: | (launched: 2022-12-14_12:26:15.509444) 12:26:19.137254 run osmo-hlr_10.42.42.2(pid=21971): stderr: | [0;m[1;31m20221214122615685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122615685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122615685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122615686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122615686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122615686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122615698 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122615706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122615706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122615707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:19.189409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21970): Terminating (SIGTERM) 12:26:19.230788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21973): Terminating (SIGTERM) 12:26:19.272509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21976): Terminating (SIGTERM) 12:26:19.314165 --- ParallelTerminationStrategy: PID 21970 died... 12:26:19.333858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21970): Terminated: ok {rc=0} 12:26:19.379369 --- ParallelTerminationStrategy: PID 21973 died... 12:26:19.398782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21973): Terminated: ok {rc=0} 12:26:19.444120 --- ParallelTerminationStrategy: PID 21976 died... 12:26:19.463489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21976): Terminated: ok {rc=0} 12:26:19.549504 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:26:20.857522 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:20.864492 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:26:20.894194 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:26:20.929436 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:26:20.983832 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:26:21.012709 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:26:21.047198 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:26:21.606592 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:26:21.611903 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:26:21.623336 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:26:21.692605 tst switch_tch_pdch.py: using LAC 40887 12:26:21.807460 tst switch_tch_pdch.py: using RAC 87 12:26:21.939303 tst switch_tch_pdch.py: using CellId 40887 12:26:22.052127 tst switch_tch_pdch.py: using BVCI 40888 12:26:22.157918 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:26:22.169525 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:26:22.180884 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:26:22.192534 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:26:22.204204 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:26:22.215866 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:26:22.227659 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:26:22.239306 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:26:22.359353 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:26:22.481983 tst switch_tch_pdch.py:51: start network... 12:26:22.694168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:23.182885 run create_hlr_db(pid=21981): Launched 12:26:23.310372 bus /gobi_6: Setting Powered False 12:26:24.372514 run create_hlr_db(pid=21981): Terminated: ok {rc=0} 12:26:24.795125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21983): Launched 12:26:25.089840 run osmo-hlr_10.42.42.2(pid=21984): Launched 12:26:25.201991 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:25.723084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21986): Launched 12:26:26.017639 run osmo-stp_10.42.42.5(pid=21987): Launched 12:26:26.129537 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:26.654613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21989): Launched 12:26:26.765937 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:27.015213 run patchelf(pid=21990): Launched 12:26:27.178520 run osmo-stp_10.42.42.5(pid=21987): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21987)] 12:26:27.303337 run osmo-stp_10.42.42.5(pid=21987): stdout: | (launched: 2022-12-14_12:26:25.962381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:27.429993 run osmo-stp_10.42.42.5(pid=21987): stderr: | [0;m[38;5;43m20221214122626132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122626133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122626133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122626133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122626135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122626136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122626136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:27.556786 run osmo-stp_10.42.42.5(pid=21987): stdout: | (launched: 2022-12-14_12:26:25.962381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:27.677108 run osmo-stp_10.42.42.5(pid=21987): stderr: | [0;m[38;5;43m20221214122626132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122626133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122626133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122626133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122626135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122626136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122626136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:27.819129 run patchelf(pid=21990): Terminating (SIGINT) 12:26:27.984160 run patchelf(pid=21990): Terminated: ok {rc=0} 12:26:28.102990 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21987): Process ended prematurely: osmo-stp_10.42.42.5(pid=21987) [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21987)] [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:26:28.112022 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 12:26:28.138456 run osmo-hlr_10.42.42.2(pid=21984): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21984)] 12:26:28.186198 run osmo-hlr_10.42.42.2(pid=21984): stdout: | (launched: 2022-12-14_12:26:25.034743) 12:26:28.235467 run osmo-hlr_10.42.42.2(pid=21984): stderr: | [0;m[1;31m20221214122625211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122625211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122625211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122625211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122625212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122625212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122625225 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122625235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122625235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122625235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:28.284940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21983): Terminating (SIGTERM) 12:26:28.324718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21986): Terminating (SIGTERM) 12:26:28.364372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21989): Terminating (SIGTERM) 12:26:28.404276 --- ParallelTerminationStrategy: PID 21983 died... 12:26:28.423653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21983): Terminated: ok {rc=0} 12:26:28.467332 --- ParallelTerminationStrategy: PID 21986 died... 12:26:28.486216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21986): Terminated: ok {rc=0} 12:26:28.529900 --- ParallelTerminationStrategy: PID 21989 died... 12:26:28.548622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21989): Terminated: ok {rc=0} 12:26:28.633399 bus /gobi_0: Setting Powered False 12:26:29.730718 bus /gobi_0: Setting Powered False 12:26:30.856558 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:26:32.131531 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:32.138621 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:26:32.169523 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:26:32.206425 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:26:32.258430 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:26:32.288325 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:26:32.323256 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:26:32.884406 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:26:32.889655 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:32.901123 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:26:32.968681 tst switch_tch_pdch.py: using LAC 40888 12:26:33.090525 tst switch_tch_pdch.py: using RAC 88 12:26:33.213442 tst switch_tch_pdch.py: using CellId 40888 12:26:33.337130 tst switch_tch_pdch.py: using BVCI 40889 12:26:33.450906 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:33.462599 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:33.473975 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:33.485354 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:33.496550 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:33.508054 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:33.519580 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:26:33.530934 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:26:33.646535 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:26:33.764920 tst switch_tch_pdch.py:51: start network... 12:26:33.976115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:34.435279 run create_hlr_db(pid=21994): Launched 12:26:34.562315 bus /gobi_6: Setting Powered False 12:26:35.624907 run create_hlr_db(pid=21994): Terminated: ok {rc=0} 12:26:36.038240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21996): Launched 12:26:36.353379 run osmo-hlr_10.42.42.2(pid=21997): Launched 12:26:36.473213 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:36.991079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21999): Launched 12:26:37.305503 run osmo-stp_10.42.42.5(pid=22000): Launched 12:26:37.425104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:26:37.944104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22002): Launched 12:26:38.064310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:26:38.330877 run patchelf(pid=22003): Launched 12:26:38.505047 run osmo-stp_10.42.42.5(pid=22000): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22000)] 12:26:38.638458 run osmo-stp_10.42.42.5(pid=22000): stdout: | (launched: 2022-12-14_12:26:37.247515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:38.773266 run osmo-stp_10.42.42.5(pid=22000): stderr: | [0;m[38;5;43m20221214122637441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122637441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122637441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122637442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122637442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122637442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122637442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:38.908135 run osmo-stp_10.42.42.5(pid=22000): stdout: | (launched: 2022-12-14_12:26:37.247515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:39.036292 run osmo-stp_10.42.42.5(pid=22000): stderr: | [0;m[38;5;43m20221214122637441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122637441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122637441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122637442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122637442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122637442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122637442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:39.188805 run patchelf(pid=22003): Terminating (SIGINT) 12:26:39.365839 run patchelf(pid=22003): Terminated: ok {rc=0} 12:26:39.492613 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22000): Process ended prematurely: osmo-stp_10.42.42.5(pid=22000) [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22000)] [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:26:39.502151 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 12:26:39.529955 run osmo-hlr_10.42.42.2(pid=21997): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21997)] 12:26:39.579571 run osmo-hlr_10.42.42.2(pid=21997): stdout: | (launched: 2022-12-14_12:26:36.294878) 12:26:39.630708 run osmo-hlr_10.42.42.2(pid=21997): stderr: | [0;m[1;31m20221214122636492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122636492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122636492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122636492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122636492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122636492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122636504 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122636512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122636513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122636513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:39.682395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21996): Terminating (SIGTERM) 12:26:39.723993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21999): Terminating (SIGTERM) 12:26:39.765972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22002): Terminating (SIGTERM) 12:26:39.807915 --- ParallelTerminationStrategy: PID 21996 died... 12:26:39.827545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21996): Terminated: ok {rc=0} 12:26:39.873405 --- ParallelTerminationStrategy: PID 21999 died... 12:26:39.892817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21999): Terminated: ok {rc=0} 12:26:39.938784 --- ParallelTerminationStrategy: PID 22002 died... 12:26:39.958401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22002): Terminated: ok {rc=0} 12:26:40.046288 bus /gobi_0: Setting Powered False 12:26:41.142241 bus /gobi_0: Setting Powered False 12:26:42.258594 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_sms:nanobts --------------------------------------------------------------------- 12:26:43.502897 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:43.506688 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 12:26:43.530001 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 12:26:43.536780 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 12:26:43.588327 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 12:26:43.611798 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 12:26:43.618661 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 12:26:44.155822 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 12:26:44.161031 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 12:26:44.171745 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 12:26:44.209187 tst mo_mt_sms.py: using LAC 40889 12:26:44.325354 tst mo_mt_sms.py: using RAC 89 12:26:44.442321 tst mo_mt_sms.py: using CellId 40889 12:26:44.557190 tst mo_mt_sms.py: using BVCI 40890 12:26:44.663520 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 12:26:44.780770 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 12:26:44.896502 tst mo_mt_sms.py:9: start nitb and bts... 12:26:45.093441 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:26:45.696196 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22007): Launched 12:26:46.055387 run osmo-nitb_10.42.42.2(pid=22008): Launched 12:26:46.248328 run osmo-nitb_10.42.42.2(pid=22008): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22008)] 12:26:46.392452 run osmo-nitb_10.42.42.2(pid=22008): stdout: | (launched: 2022-12-14_12:26:45.981372) 12:26:46.541053 run osmo-nitb_10.42.42.2(pid=22008): stderr: | (launched: 2022-12-14_12:26:46.036426) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:26:46.688231 run osmo-nitb_10.42.42.2(pid=22008): stdout: | (launched: 2022-12-14_12:26:45.981372) 12:26:46.828272 run osmo-nitb_10.42.42.2(pid=22008): stderr: | (launched: 2022-12-14_12:26:46.036426) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22008): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22008) [trial-2404↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22008)] 12:26:47.189848 tst osmo-nitb_10.42.42.2(pid=22008): stdout: | (launched: 2022-12-14_12:26:45.981372) 12:26:47.316645 tst osmo-nitb_10.42.42.2(pid=22008): stderr: | (launched: 2022-12-14_12:26:46.036426) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:26:47.466024 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22008): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22008) [trial-2404↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22008)] [trial-2404↪nitb_sms:nanobts↪mo_mt_sms.py:11] 12:26:47.474957 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 12:26:47.481914 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22007): Terminating (SIGTERM) 12:26:47.691715 --- ParallelTerminationStrategy: PID 22007 died... 12:26:47.712876 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22007): Terminated: ok {rc=0} 12:26:47.799857 bus /sierra_3: Setting Powered False 12:26:48.898636 bus /sierra_3: Setting Powered False 12:26:50.013945 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 sms:nanobts+band-1900 --------------------------------------------------------------------- 12:26:51.202434 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:51.208228 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:26:51.232457 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:26:51.259659 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 12:26:51.310395 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:26:51.334106 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:26:51.360709 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 12:26:51.907460 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 12:26:51.912462 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:26:51.923147 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:26:51.959506 tst mo_mt_sms.py: using LAC 40890 12:26:52.077914 tst mo_mt_sms.py: using RAC 90 12:26:52.191939 tst mo_mt_sms.py: using CellId 40890 12:26:52.304625 tst mo_mt_sms.py: using BVCI 40891 12:26:52.409901 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:26:52.420407 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:26:52.430890 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:26:52.441524 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:26:52.452279 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:26:52.463070 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 12:26:52.581705 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 12:26:52.697934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:53.153674 run create_hlr_db(pid=22012): Launched 12:26:53.264623 bus /sierra_2: Setting Powered False 12:26:54.323260 run create_hlr_db(pid=22012): Terminated: ok {rc=0} 12:26:54.734117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22014): Launched 12:26:55.026907 run osmo-hlr_10.42.42.2(pid=22015): Launched 12:26:55.137819 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:55.639961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22017): Launched 12:26:55.932846 run osmo-stp_10.42.42.5(pid=22018): Launched 12:26:56.043897 run osmo-msc_10.42.42.6: Starting osmo-msc 12:26:56.574817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22020): Launched 12:26:56.868689 run osmo-msc_10.42.42.6(pid=22021): Launched 12:26:57.032029 run osmo-stp_10.42.42.5(pid=22018): ERR: Terminated: ERROR {rc=1} [trial-2404↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22018)] 12:26:57.156572 run osmo-stp_10.42.42.5(pid=22018): stdout: | (launched: 2022-12-14_12:26:55.878157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:57.281964 run osmo-stp_10.42.42.5(pid=22018): stderr: | [0;m[38;5;43m20221214122656048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122656048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122656049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122656049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122656049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122656050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122656050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:57.404723 run osmo-stp_10.42.42.5(pid=22018): stdout: | (launched: 2022-12-14_12:26:55.878157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:57.521533 run osmo-stp_10.42.42.5(pid=22018): stderr: | [0;m[38;5;43m20221214122656048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122656048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122656049 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122656049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122656049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122656050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122656050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:57.661397 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22018): Process ended prematurely: osmo-stp_10.42.42.5(pid=22018) [trial-2404↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22018)] [trial-2404↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 12:26:57.670098 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 12:26:57.695802 run osmo-hlr_10.42.42.2(pid=22015): ERR: Terminated: ERROR {rc=237} [trial-2404↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22015)] 12:26:57.743841 run osmo-hlr_10.42.42.2(pid=22015): stdout: | (launched: 2022-12-14_12:26:54.972094) 12:26:57.793053 run osmo-hlr_10.42.42.2(pid=22015): stderr: | [0;m[1;31m20221214122655146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122655146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122655146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122655146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122655146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122655146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122655202 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122655212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122655213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122655213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:57.861608 run osmo-msc_10.42.42.6(pid=22021): ERR: Terminated: ERROR {rc=2} [trial-2404↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22021)] 12:26:57.908409 run osmo-msc_10.42.42.6(pid=22021): stdout: | (launched: 2022-12-14_12:26:56.813880) 12:26:57.957186 run osmo-msc_10.42.42.6(pid=22021): stderr: | [0;m[38;5;43m20221214122657083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122657083 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbc3d951c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122657083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122657083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122657084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122657084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122657085 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122657086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122657086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122657086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:26:58.006396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22014): Terminating (SIGTERM) 12:26:58.046211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22017): Terminating (SIGTERM) 12:26:58.085808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22020): Terminating (SIGTERM) 12:26:58.125791 --- ParallelTerminationStrategy: PID 22014 died... 12:26:58.145236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22014): Terminated: ok {rc=0} 12:26:58.189127 --- ParallelTerminationStrategy: PID 22017 died... 12:26:58.208000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22017): Terminated: ok {rc=0} 12:26:58.251705 --- ParallelTerminationStrategy: PID 22020 died... 12:26:58.270501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22020): Terminated: ok {rc=0} 12:26:58.355742 bus /sierra_3: Setting Powered False 12:26:59.452867 bus /sierra_3: Setting Powered False 12:27:00.564344 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 12:27:01.788009 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:01.793126 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:27:01.818985 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 12:27:01.828192 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 12:27:01.864665 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:27:01.891445 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 12:27:01.899137 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 12:27:02.416309 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 12:27:02.421481 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 12:27:02.432657 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:27:02.470846 tst assert_extension.py: using LAC 40891 12:27:02.595902 tst assert_extension.py: using RAC 91 12:27:02.718618 tst assert_extension.py: using CellId 40891 12:27:02.841191 tst assert_extension.py: using BVCI 40892 12:27:02.954395 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 12:27:03.068437 tst assert_extension.py:10: start nitb and bts... 12:27:03.264509 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:27:03.864512 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22027): Launched 12:27:04.157586 run osmo-nitb_10.42.42.2(pid=22028): Launched 12:27:04.319929 run osmo-nitb_10.42.42.2(pid=22028): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22028)] 12:27:04.452057 run osmo-nitb_10.42.42.2(pid=22028): stdout: | (launched: 2022-12-14_12:27:04.102679) 12:27:04.585804 run osmo-nitb_10.42.42.2(pid=22028): stderr: | (launched: 2022-12-14_12:27:04.146104) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:27:04.719570 run osmo-nitb_10.42.42.2(pid=22028): stdout: | (launched: 2022-12-14_12:27:04.102679) 12:27:04.847466 run osmo-nitb_10.42.42.2(pid=22028): stderr: | (launched: 2022-12-14_12:27:04.146104) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22028): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22028) [trial-2404↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22028)] 12:27:05.267756 tst osmo-nitb_10.42.42.2(pid=22028): stdout: | (launched: 2022-12-14_12:27:04.102679) 12:27:05.386885 tst osmo-nitb_10.42.42.2(pid=22028): stderr: | (launched: 2022-12-14_12:27:04.146104) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:27:05.527376 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22028): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22028) [trial-2404↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22028)] [trial-2404↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 12:27:05.535879 tst assert_extension.py:12: Test FAILED (3.1 sec) 12:27:05.542228 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22027): Terminating (SIGTERM) 12:27:05.751643 --- ParallelTerminationStrategy: PID 22027 died... 12:27:05.772120 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22027): Terminated: ok {rc=0} 12:27:05.858653 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 ussd:nanobts+band-1900 --------------------------------------------------------------------- 12:27:07.026971 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:07.033712 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:27:07.057674 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:27:07.086073 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 12:27:07.123978 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:27:07.149645 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:27:07.176542 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 12:27:07.700881 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 12:27:07.706064 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:27:07.716642 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:27:07.761282 tst assert_extension.py: using LAC 40892 12:27:07.875216 tst assert_extension.py: using RAC 92 12:27:07.988571 tst assert_extension.py: using CellId 40892 12:27:08.102117 tst assert_extension.py: using BVCI 40893 12:27:08.207686 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:27:08.218530 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:27:08.229364 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:27:08.239637 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:27:08.250637 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:27:08.261660 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 12:27:08.380614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:08.866606 run create_hlr_db(pid=22032): Launched 12:27:08.980656 bus /sierra_2: Setting Powered False 12:27:10.043019 run create_hlr_db(pid=22032): Terminated: ok {rc=0} 12:27:10.464561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22034): Launched 12:27:10.758207 run osmo-hlr_10.42.42.2(pid=22035): Launched 12:27:10.869495 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:11.391882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22037): Launched 12:27:11.686142 run osmo-stp_10.42.42.5(pid=22038): Launched 12:27:11.797797 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:12.328848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22040): Launched 12:27:12.622697 run osmo-msc_10.42.42.6(pid=22041): Launched 12:27:12.786476 run osmo-stp_10.42.42.5(pid=22038): ERR: Terminated: ERROR {rc=1} [trial-2404↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22038)] 12:27:12.911524 run osmo-stp_10.42.42.5(pid=22038): stdout: | (launched: 2022-12-14_12:27:11.631270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:13.036449 run osmo-stp_10.42.42.5(pid=22038): stderr: | [0;m[38;5;43m20221214122711800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122711800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122711800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122711801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122711801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122711801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122711801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:13.159282 run osmo-stp_10.42.42.5(pid=22038): stdout: | (launched: 2022-12-14_12:27:11.631270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:13.276177 run osmo-stp_10.42.42.5(pid=22038): stderr: | [0;m[38;5;43m20221214122711800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122711800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122711800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122711801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122711801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122711801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122711801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:13.415998 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22038): Process ended prematurely: osmo-stp_10.42.42.5(pid=22038) [trial-2404↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22038)] [trial-2404↪ussd:nanobts+band-1900↪assert_extension.py:17] 12:27:13.424392 tst assert_extension.py:17: Test FAILED (5.7 sec) 12:27:13.450222 run osmo-hlr_10.42.42.2(pid=22035): ERR: Terminated: ERROR {rc=237} [trial-2404↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22035)] 12:27:13.498697 run osmo-hlr_10.42.42.2(pid=22035): stdout: | (launched: 2022-12-14_12:27:10.703168) 12:27:13.548241 run osmo-hlr_10.42.42.2(pid=22035): stderr: | [0;m[1;31m20221214122710881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122710881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122710881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122710881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122710881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122710881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122710893 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122710901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122710901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122710901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:13.617078 run osmo-msc_10.42.42.6(pid=22041): ERR: Terminated: ERROR {rc=2} [trial-2404↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22041)] 12:27:13.664206 run osmo-msc_10.42.42.6(pid=22041): stdout: | (launched: 2022-12-14_12:27:12.567771) 12:27:13.713250 run osmo-msc_10.42.42.6(pid=22041): stderr: | [0;m[38;5;43m20221214122712838 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122712838 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ab32b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122712838 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122712838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122712838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122712839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122712840 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122712841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122712841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122712841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:13.762927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22034): Terminating (SIGTERM) 12:27:13.803093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22037): Terminating (SIGTERM) 12:27:13.843007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22040): Terminating (SIGTERM) 12:27:13.883921 --- ParallelTerminationStrategy: PID 22034 died... 12:27:13.903568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22034): Terminated: ok {rc=0} 12:27:13.947373 --- ParallelTerminationStrategy: PID 22037 died... 12:27:13.966081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22037): Terminated: ok {rc=0} 12:27:14.009532 --- ParallelTerminationStrategy: PID 22040 died... 12:27:14.028136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22040): Terminated: ok {rc=0} 12:27:14.113118 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:27:15.311012 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:15.318261 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:27:15.341543 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:27:15.369197 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:27:15.420726 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:27:15.444116 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:27:15.470700 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:27:16.023060 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:27:16.092033 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:16.104067 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:27:16.165419 tst mo_mt_call.py: using LAC 40893 12:27:16.315092 tst mo_mt_call.py: using RAC 93 12:27:16.436868 tst mo_mt_call.py: using CellId 40893 12:27:16.564292 tst mo_mt_call.py: using BVCI 40894 12:27:16.705757 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:16.717906 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:16.729652 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:16.741433 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:16.754402 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:16.767970 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:27:16.891034 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:27:17.031921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:17.521205 run create_hlr_db(pid=22046): Launched 12:27:17.636435 bus /sierra_2: Setting Powered False 12:27:18.696838 run create_hlr_db(pid=22046): Terminated: ok {rc=0} 12:27:19.134720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22048): Launched 12:27:19.455219 run osmo-hlr_10.42.42.2(pid=22049): Launched 12:27:19.577287 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:20.128437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22051): Launched 12:27:20.449180 run osmo-stp_10.42.42.5(pid=22052): Launched 12:27:20.570734 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:21.151395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22054): Launched 12:27:21.473627 run osmo-msc_10.42.42.6(pid=22055): Launched 12:27:21.653216 run osmo-stp_10.42.42.5(pid=22052): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22052)] 12:27:21.789257 run osmo-stp_10.42.42.5(pid=22052): stdout: | (launched: 2022-12-14_12:27:20.390197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:21.925527 run osmo-stp_10.42.42.5(pid=22052): stderr: | [0;m[38;5;43m20221214122720583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122720584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122720584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122720584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122720585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122720585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122720585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:22.059996 run osmo-stp_10.42.42.5(pid=22052): stdout: | (launched: 2022-12-14_12:27:20.390197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:22.187448 run osmo-stp_10.42.42.5(pid=22052): stderr: | [0;m[38;5;43m20221214122720583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122720584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122720584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122720584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122720585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122720585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122720585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:22.339959 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22052): Process ended prematurely: osmo-stp_10.42.42.5(pid=22052) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22052)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:27:22.349771 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:27:22.377190 run osmo-hlr_10.42.42.2(pid=22049): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22049)] 12:27:22.426540 run osmo-hlr_10.42.42.2(pid=22049): stdout: | (launched: 2022-12-14_12:27:19.396321) 12:27:22.477767 run osmo-hlr_10.42.42.2(pid=22049): stderr: | [0;m[1;31m20221214122719594 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122719595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122719595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122719595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122719595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122719595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122719610 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122719619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122719620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122719620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:22.549054 run osmo-msc_10.42.42.6(pid=22055): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22055)] 12:27:22.598577 run osmo-msc_10.42.42.6(pid=22055): stdout: | (launched: 2022-12-14_12:27:21.414253) 12:27:22.649388 run osmo-msc_10.42.42.6(pid=22055): stderr: | [0;m[38;5;43m20221214122721735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122721735 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff29169c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122721735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122721735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122721735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122721735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122721737 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122721738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122721738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122721738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:22.700325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22048): Terminating (SIGTERM) 12:27:22.741335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22051): Terminating (SIGTERM) 12:27:22.782404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22054): Terminating (SIGTERM) 12:27:22.823749 --- ParallelTerminationStrategy: PID 22048 died... 12:27:22.843421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22048): Terminated: ok {rc=0} 12:27:22.889102 --- ParallelTerminationStrategy: PID 22051 died... 12:27:22.908429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22051): Terminated: ok {rc=0} 12:27:22.953456 --- ParallelTerminationStrategy: PID 22054 died... 12:27:22.972626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22054): Terminated: ok {rc=0} 12:27:23.059112 bus /sierra_3: Setting Powered False 12:27:24.156821 bus /sierra_3: Setting Powered False 12:27:25.271627 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:27:26.419154 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:26.431535 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:27:26.494188 tst mo_mt_call_osmux.py: using LAC 40894 12:27:26.612384 tst mo_mt_call_osmux.py: using RAC 94 12:27:26.732499 tst mo_mt_call_osmux.py: using CellId 40894 12:27:26.859662 tst mo_mt_call_osmux.py: using BVCI 40895 12:27:26.975590 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:26.987380 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:26.998893 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:27.010472 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:27.022160 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:27:27.033726 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:27:27.152660 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:27:27.270772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:27.736921 run create_hlr_db(pid=22057): Launched 12:27:27.851645 bus /sierra_2: Setting Powered False 12:27:28.910662 run create_hlr_db(pid=22057): Terminated: ok {rc=0} 12:27:29.351180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22059): Launched 12:27:29.673733 run osmo-hlr_10.42.42.2(pid=22060): Launched 12:27:29.795654 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:30.351999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22062): Launched 12:27:30.673231 run osmo-stp_10.42.42.5(pid=22063): Launched 12:27:30.794910 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:31.493819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22065): Launched 12:27:31.829680 run osmo-msc_10.42.42.6(pid=22066): Launched 12:27:32.039725 run osmo-stp_10.42.42.5(pid=22063): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22063)] 12:27:32.197377 run osmo-stp_10.42.42.5(pid=22063): stdout: | (launched: 2022-12-14_12:27:30.613850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:32.386100 run osmo-stp_10.42.42.5(pid=22063): stderr: | [0;m[38;5;43m20221214122730805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122730805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122730806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122730806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122730806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122730807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122730807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:32.522717 run osmo-stp_10.42.42.5(pid=22063): stdout: | (launched: 2022-12-14_12:27:30.613850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:32.652055 run osmo-stp_10.42.42.5(pid=22063): stderr: | [0;m[38;5;43m20221214122730805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122730805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122730806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122730806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122730806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122730807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122730807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:32.804555 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22063): Process ended prematurely: osmo-stp_10.42.42.5(pid=22063) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22063)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:27:32.814583 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:27:32.842423 run osmo-hlr_10.42.42.2(pid=22060): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22060)] 12:27:32.892150 run osmo-hlr_10.42.42.2(pid=22060): stdout: | (launched: 2022-12-14_12:27:29.614056) 12:27:32.943589 run osmo-hlr_10.42.42.2(pid=22060): stderr: | [0;m[1;31m20221214122729814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122729814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122729814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122729814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122729814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122729814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122729827 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122729838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122729838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122729838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:33.015723 run osmo-msc_10.42.42.6(pid=22066): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22066)] 12:27:33.065264 run osmo-msc_10.42.42.6(pid=22066): stdout: | (launched: 2022-12-14_12:27:31.762369) 12:27:33.116550 run osmo-msc_10.42.42.6(pid=22066): stderr: | [0;m[38;5;43m20221214122732393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122732393 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9104ceac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122732393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122732393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122732394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122732394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122732395 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122732396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122732396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122732396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:33.168179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22059): Terminating (SIGTERM) 12:27:33.210044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22062): Terminating (SIGTERM) 12:27:33.252333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22065): Terminating (SIGTERM) 12:27:33.294202 --- ParallelTerminationStrategy: PID 22059 died... 12:27:33.314407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22059): Terminated: ok {rc=0} 12:27:33.360567 --- ParallelTerminationStrategy: PID 22062 died... 12:27:33.380241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22062): Terminated: ok {rc=0} 12:27:33.425892 --- ParallelTerminationStrategy: PID 22065 died... 12:27:33.445469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22065): Terminated: ok {rc=0} 12:27:33.532573 bus /sierra_3: Setting Powered False 12:27:34.631975 bus /sierra_3: Setting Powered False 12:27:35.747884 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:27:36.993994 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:37.001916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:27:37.026011 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:27:37.053492 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:27:37.105609 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:27:37.130075 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:27:37.157371 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:27:37.710352 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:27:37.761454 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:37.772507 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:27:37.829247 tst mo_mt_call.py: using LAC 40895 12:27:37.944294 tst mo_mt_call.py: using RAC 95 12:27:38.059778 tst mo_mt_call.py: using CellId 40895 12:27:38.174530 tst mo_mt_call.py: using BVCI 40896 12:27:38.284195 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:38.295371 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:38.306423 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:38.317462 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:38.328731 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:38.340052 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:27:38.459824 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:27:38.575757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:39.039129 run create_hlr_db(pid=22071): Launched 12:27:39.153448 bus /sierra_2: Setting Powered False 12:27:40.213092 run create_hlr_db(pid=22071): Terminated: ok {rc=0} 12:27:40.632708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22073): Launched 12:27:40.953074 run osmo-hlr_10.42.42.2(pid=22074): Launched 12:27:41.074629 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:41.630750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22076): Launched 12:27:41.951540 run osmo-stp_10.42.42.5(pid=22077): Launched 12:27:42.072399 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:42.652270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22079): Launched 12:27:42.972220 run osmo-msc_10.42.42.6(pid=22080): Launched 12:27:43.150682 run osmo-stp_10.42.42.5(pid=22077): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22077)] 12:27:43.286751 run osmo-stp_10.42.42.5(pid=22077): stdout: | (launched: 2022-12-14_12:27:41.892513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:43.421905 run osmo-stp_10.42.42.5(pid=22077): stderr: | [0;m[38;5;43m20221214122742084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122742084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122742085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122742085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122742086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122742086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122742086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:43.556410 run osmo-stp_10.42.42.5(pid=22077): stdout: | (launched: 2022-12-14_12:27:41.892513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:43.683509 run osmo-stp_10.42.42.5(pid=22077): stderr: | [0;m[38;5;43m20221214122742084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122742084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122742085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122742085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122742086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122742086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122742086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:43.836603 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22077): Process ended prematurely: osmo-stp_10.42.42.5(pid=22077) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22077)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:27:43.846179 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:27:43.873544 run osmo-hlr_10.42.42.2(pid=22074): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22074)] 12:27:43.922836 run osmo-hlr_10.42.42.2(pid=22074): stdout: | (launched: 2022-12-14_12:27:40.893913) 12:27:43.973635 run osmo-hlr_10.42.42.2(pid=22074): stderr: | [0;m[1;31m20221214122741093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122741093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122741093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122741093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122741093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122741093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122741106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122741114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122741114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122741114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:44.045373 run osmo-msc_10.42.42.6(pid=22080): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22080)] 12:27:44.094733 run osmo-msc_10.42.42.6(pid=22080): stdout: | (launched: 2022-12-14_12:27:42.913153) 12:27:44.145575 run osmo-msc_10.42.42.6(pid=22080): stderr: | [0;m[38;5;43m20221214122743234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122743235 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2433affc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122743235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122743235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122743235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122743235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122743237 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122743237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122743237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122743237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:44.196779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22073): Terminating (SIGTERM) 12:27:44.238302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22076): Terminating (SIGTERM) 12:27:44.279562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22079): Terminating (SIGTERM) 12:27:44.321092 --- ParallelTerminationStrategy: PID 22073 died... 12:27:44.340832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22073): Terminated: ok {rc=0} 12:27:44.386300 --- ParallelTerminationStrategy: PID 22076 died... 12:27:44.405487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22076): Terminated: ok {rc=0} 12:27:44.450708 --- ParallelTerminationStrategy: PID 22079 died... 12:27:44.469971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22079): Terminated: ok {rc=0} 12:27:44.556843 bus /sierra_3: Setting Powered False 12:27:45.654172 bus /sierra_3: Setting Powered False 12:27:46.768305 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:27:47.915151 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:47.926905 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:27:47.986032 tst mo_mt_call_osmux.py: using LAC 40896 12:27:48.115812 tst mo_mt_call_osmux.py: using RAC 96 12:27:48.242051 tst mo_mt_call_osmux.py: using CellId 40896 12:27:48.367757 tst mo_mt_call_osmux.py: using BVCI 40897 12:27:48.483813 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:48.495547 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:48.506999 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:48.518943 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:48.530496 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:27:48.541955 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:27:48.658891 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:27:48.779731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:49.277267 run create_hlr_db(pid=22082): Launched 12:27:49.406747 bus /sierra_2: Setting Powered False 12:27:50.470057 run create_hlr_db(pid=22082): Terminated: ok {rc=0} 12:27:50.899039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22084): Launched 12:27:51.198798 run osmo-hlr_10.42.42.2(pid=22085): Launched 12:27:51.312217 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:51.846821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22087): Launched 12:27:52.145897 run osmo-stp_10.42.42.5(pid=22088): Launched 12:27:52.259228 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:52.806340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22090): Launched 12:27:53.106457 run osmo-msc_10.42.42.6(pid=22091): Launched 12:27:53.273598 run osmo-stp_10.42.42.5(pid=22088): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22088)] 12:27:53.400644 run osmo-stp_10.42.42.5(pid=22088): stdout: | (launched: 2022-12-14_12:27:52.090213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:53.527951 run osmo-stp_10.42.42.5(pid=22088): stderr: | [0;m[38;5;43m20221214122752264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122752264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122752264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122752265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122752265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122752265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122752265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:53.653377 run osmo-stp_10.42.42.5(pid=22088): stdout: | (launched: 2022-12-14_12:27:52.090213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:53.772448 run osmo-stp_10.42.42.5(pid=22088): stderr: | [0;m[38;5;43m20221214122752264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122752264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122752264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122752265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122752265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122752265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122752265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:53.915783 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22088): Process ended prematurely: osmo-stp_10.42.42.5(pid=22088) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22088)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:27:53.924716 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:27:53.950870 run osmo-hlr_10.42.42.2(pid=22085): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22085)] 12:27:53.999822 run osmo-hlr_10.42.42.2(pid=22085): stdout: | (launched: 2022-12-14_12:27:51.143062) 12:27:54.049327 run osmo-hlr_10.42.42.2(pid=22085): stderr: | [0;m[1;31m20221214122751322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122751322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122751322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122751322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122751322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122751322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122751335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122751343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122751344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122751344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:54.118982 run osmo-msc_10.42.42.6(pid=22091): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22091)] 12:27:54.165836 run osmo-msc_10.42.42.6(pid=22091): stdout: | (launched: 2022-12-14_12:27:53.050753) 12:27:54.215064 run osmo-msc_10.42.42.6(pid=22091): stderr: | [0;m[38;5;43m20221214122753320 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122753321 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e2b12bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122753321 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122753321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122753321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122753321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122753323 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122753323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122753323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122753324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:54.264716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22084): Terminating (SIGTERM) 12:27:54.304896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22087): Terminating (SIGTERM) 12:27:54.345024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22090): Terminating (SIGTERM) 12:27:54.385285 --- ParallelTerminationStrategy: PID 22084 died... 12:27:54.405014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22084): Terminated: ok {rc=0} 12:27:54.449138 --- ParallelTerminationStrategy: PID 22087 died... 12:27:54.468308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22087): Terminated: ok {rc=0} 12:27:54.512238 --- ParallelTerminationStrategy: PID 22090 died... 12:27:54.531889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22090): Terminated: ok {rc=0} 12:27:54.618638 bus /sierra_3: Setting Powered False 12:27:55.719991 bus /sierra_3: Setting Powered False 12:27:56.837647 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:27:58.085475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:58.095031 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:27:58.119252 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:27:58.147763 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:27:58.199762 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:27:58.225002 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:27:58.253634 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:27:58.802863 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:27:58.851971 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:58.863670 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:27:58.923949 tst mo_mt_call.py: using LAC 40897 12:27:59.039516 tst mo_mt_call.py: using RAC 97 12:27:59.156247 tst mo_mt_call.py: using CellId 40897 12:27:59.273752 tst mo_mt_call.py: using BVCI 40898 12:27:59.383964 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:59.395191 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:59.406211 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:59.417172 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:59.428508 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:27:59.439849 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:27:59.560782 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:27:59.681834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:00.179359 run create_hlr_db(pid=22096): Launched 12:28:00.310752 bus /sierra_2: Setting Powered False 12:28:01.373130 run create_hlr_db(pid=22096): Terminated: ok {rc=0} 12:28:01.832066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22098): Launched 12:28:02.161309 run osmo-hlr_10.42.42.2(pid=22099): Launched 12:28:02.284310 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:02.838460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22101): Launched 12:28:03.161608 run osmo-stp_10.42.42.5(pid=22102): Launched 12:28:03.284049 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:03.863587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22104): Launched 12:28:04.183977 run osmo-msc_10.42.42.6(pid=22105): Launched 12:28:04.362532 run osmo-stp_10.42.42.5(pid=22102): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22102)] 12:28:04.497518 run osmo-stp_10.42.42.5(pid=22102): stdout: | (launched: 2022-12-14_12:28:03.102166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:04.634590 run osmo-stp_10.42.42.5(pid=22102): stderr: | [0;m[38;5;43m20221214122803297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122803298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122803298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122803298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122803299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122803299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122803299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:04.768805 run osmo-stp_10.42.42.5(pid=22102): stdout: | (launched: 2022-12-14_12:28:03.102166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:04.895570 run osmo-stp_10.42.42.5(pid=22102): stderr: | [0;m[38;5;43m20221214122803297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122803298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122803298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122803298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122803299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122803299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122803299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:05.047547 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22102): Process ended prematurely: osmo-stp_10.42.42.5(pid=22102) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22102)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:28:05.057089 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:28:05.084438 run osmo-hlr_10.42.42.2(pid=22099): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22099)] 12:28:05.133562 run osmo-hlr_10.42.42.2(pid=22099): stdout: | (launched: 2022-12-14_12:28:02.100438) 12:28:05.184381 run osmo-hlr_10.42.42.2(pid=22099): stderr: | [0;m[1;31m20221214122802304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122802304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122802304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122802304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122802304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122802304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122802317 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122802325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122802325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122802325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:05.255910 run osmo-msc_10.42.42.6(pid=22105): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22105)] 12:28:05.304936 run osmo-msc_10.42.42.6(pid=22105): stdout: | (launched: 2022-12-14_12:28:04.124571) 12:28:05.355660 run osmo-msc_10.42.42.6(pid=22105): stderr: | [0;m[38;5;43m20221214122804447 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122804447 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5a61300c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122804447 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122804447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122804447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122804447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122804449 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122804450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122804450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122804450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:05.406421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22098): Terminating (SIGTERM) 12:28:05.447331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22101): Terminating (SIGTERM) 12:28:05.489090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22104): Terminating (SIGTERM) 12:28:05.530623 --- ParallelTerminationStrategy: PID 22098 died... 12:28:05.550345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22098): Terminated: ok {rc=0} 12:28:05.595831 --- ParallelTerminationStrategy: PID 22101 died... 12:28:05.615110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22101): Terminated: ok {rc=0} 12:28:05.660195 --- ParallelTerminationStrategy: PID 22104 died... 12:28:05.679413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22104): Terminated: ok {rc=0} 12:28:05.765909 bus /sierra_3: Setting Powered False 12:28:06.863391 bus /sierra_3: Setting Powered False 12:28:07.977094 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:28:09.118098 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:28:09.130015 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:28:09.190047 tst mo_mt_call_osmux.py: using LAC 40898 12:28:09.308204 tst mo_mt_call_osmux.py: using RAC 98 12:28:09.425108 tst mo_mt_call_osmux.py: using CellId 40898 12:28:09.543246 tst mo_mt_call_osmux.py: using BVCI 40899 12:28:09.653699 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:28:09.665041 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:28:09.676092 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:28:09.687109 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:28:09.698542 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:28:09.709904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:28:09.829951 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:28:09.946821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:10.410393 run create_hlr_db(pid=22107): Launched 12:28:10.523264 bus /sierra_2: Setting Powered False 12:28:11.583062 run create_hlr_db(pid=22107): Terminated: ok {rc=0} 12:28:12.021342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22109): Launched 12:28:12.342646 run osmo-hlr_10.42.42.2(pid=22110): Launched 12:28:12.464467 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:13.018918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22112): Launched 12:28:13.340570 run osmo-stp_10.42.42.5(pid=22113): Launched 12:28:13.462445 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:14.050177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22115): Launched 12:28:14.372813 run osmo-msc_10.42.42.6(pid=22116): Launched 12:28:14.550561 run osmo-stp_10.42.42.5(pid=22113): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22113)] 12:28:14.685948 run osmo-stp_10.42.42.5(pid=22113): stdout: | (launched: 2022-12-14_12:28:13.281150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:14.823568 run osmo-stp_10.42.42.5(pid=22113): stderr: | [0;m[38;5;43m20221214122813475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122813475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122813476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122813476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122813477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122813477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122813477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:14.958300 run osmo-stp_10.42.42.5(pid=22113): stdout: | (launched: 2022-12-14_12:28:13.281150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:15.085470 run osmo-stp_10.42.42.5(pid=22113): stderr: | [0;m[38;5;43m20221214122813475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122813475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122813476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122813476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122813477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122813477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122813477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:15.238654 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22113): Process ended prematurely: osmo-stp_10.42.42.5(pid=22113) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22113)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:28:15.248360 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:28:15.275878 run osmo-hlr_10.42.42.2(pid=22110): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22110)] 12:28:15.325324 run osmo-hlr_10.42.42.2(pid=22110): stdout: | (launched: 2022-12-14_12:28:12.283450) 12:28:15.376277 run osmo-hlr_10.42.42.2(pid=22110): stderr: | [0;m[1;31m20221214122812483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122812483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122812483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122812483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122812483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122812483 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122812496 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122812504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122812504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122812504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:15.447528 run osmo-msc_10.42.42.6(pid=22116): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22116)] 12:28:15.497110 run osmo-msc_10.42.42.6(pid=22116): stdout: | (launched: 2022-12-14_12:28:14.313112) 12:28:15.547786 run osmo-msc_10.42.42.6(pid=22116): stderr: | [0;m[38;5;43m20221214122814637 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122814637 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc2f7150c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122814637 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122814638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122814638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122814638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122814639 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122814640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122814640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122814640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:15.599771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22109): Terminating (SIGTERM) 12:28:15.641092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22112): Terminating (SIGTERM) 12:28:15.682779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22115): Terminating (SIGTERM) 12:28:15.724336 --- ParallelTerminationStrategy: PID 22109 died... 12:28:15.744137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22109): Terminated: ok {rc=0} 12:28:15.789888 --- ParallelTerminationStrategy: PID 22112 died... 12:28:15.809309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22112): Terminated: ok {rc=0} 12:28:15.855360 --- ParallelTerminationStrategy: PID 22115 died... 12:28:15.875164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22115): Terminated: ok {rc=0} 12:28:15.966925 bus /sierra_3: Setting Powered False 12:28:17.071984 bus /sierra_3: Setting Powered False 12:28:18.200330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:28:19.437771 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:28:19.446412 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:28:19.470826 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:28:19.498493 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:28:19.550735 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:28:19.575241 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:28:19.602191 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:28:20.152211 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:28:20.203836 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:20.215514 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:28:20.276916 tst mo_mt_call.py: using LAC 40899 12:28:20.402120 tst mo_mt_call.py: using RAC 99 12:28:20.526882 tst mo_mt_call.py: using CellId 40899 12:28:20.651867 tst mo_mt_call.py: using BVCI 40900 12:28:20.767311 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:20.779011 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:20.790420 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:20.801913 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:20.813528 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:20.825060 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:28:20.943889 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:28:21.061150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:21.522630 run create_hlr_db(pid=22121): Launched 12:28:21.643904 bus /sierra_2: Setting Powered False 12:28:22.704047 run create_hlr_db(pid=22121): Terminated: ok {rc=0} 12:28:23.141879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22123): Launched 12:28:23.463701 run osmo-hlr_10.42.42.2(pid=22124): Launched 12:28:23.584909 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:24.137295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22126): Launched 12:28:24.457855 run osmo-stp_10.42.42.5(pid=22127): Launched 12:28:24.579079 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:25.159103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22129): Launched 12:28:25.479348 run osmo-msc_10.42.42.6(pid=22130): Launched 12:28:25.656631 run osmo-stp_10.42.42.5(pid=22127): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22127)] 12:28:25.791506 run osmo-stp_10.42.42.5(pid=22127): stdout: | (launched: 2022-12-14_12:28:24.398584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:25.926310 run osmo-stp_10.42.42.5(pid=22127): stderr: | [0;m[38;5;43m20221214122824593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122824593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122824593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122824594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122824594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122824594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122824594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:26.060379 run osmo-stp_10.42.42.5(pid=22127): stdout: | (launched: 2022-12-14_12:28:24.398584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:26.187457 run osmo-stp_10.42.42.5(pid=22127): stderr: | [0;m[38;5;43m20221214122824593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122824593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122824593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122824594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122824594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122824594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122824594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:26.339803 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22127): Process ended prematurely: osmo-stp_10.42.42.5(pid=22127) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22127)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:28:26.349395 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:28:26.377028 run osmo-hlr_10.42.42.2(pid=22124): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22124)] 12:28:26.426266 run osmo-hlr_10.42.42.2(pid=22124): stdout: | (launched: 2022-12-14_12:28:23.404572) 12:28:26.478069 run osmo-hlr_10.42.42.2(pid=22124): stderr: | [0;m[1;31m20221214122823603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122823603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122823603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122823603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122823603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122823603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122823615 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122823623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122823624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122823624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:26.549271 run osmo-msc_10.42.42.6(pid=22130): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22130)] 12:28:26.598449 run osmo-msc_10.42.42.6(pid=22130): stdout: | (launched: 2022-12-14_12:28:25.420314) 12:28:26.649078 run osmo-msc_10.42.42.6(pid=22130): stderr: | [0;m[38;5;43m20221214122825742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122825743 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbdd9958c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122825743 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122825743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122825743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122825743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122825745 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122825745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122825745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122825746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:26.700146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22123): Terminating (SIGTERM) 12:28:26.741450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22126): Terminating (SIGTERM) 12:28:26.782563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22129): Terminating (SIGTERM) 12:28:26.824703 --- ParallelTerminationStrategy: PID 22123 died... 12:28:26.844547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22123): Terminated: ok {rc=0} 12:28:26.889860 --- ParallelTerminationStrategy: PID 22126 died... 12:28:26.909155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22126): Terminated: ok {rc=0} 12:28:26.954155 --- ParallelTerminationStrategy: PID 22129 died... 12:28:26.973456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22129): Terminated: ok {rc=0} 12:28:27.060903 bus /sierra_3: Setting Powered False 12:28:28.158667 bus /sierra_3: Setting Powered False 12:28:29.271805 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:28:30.417582 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:30.429918 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:28:30.491086 tst mo_mt_call_osmux.py: using LAC 40900 12:28:30.616251 tst mo_mt_call_osmux.py: using RAC 100 12:28:30.743328 tst mo_mt_call_osmux.py: using CellId 40900 12:28:30.874350 tst mo_mt_call_osmux.py: using BVCI 40901 12:28:31.028675 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:31.042141 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:31.054445 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:31.066687 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:31.079891 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:28:31.093057 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:28:31.217556 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:28:31.336182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:31.818780 run create_hlr_db(pid=22133): Launched 12:28:32.033649 bus /sierra_2: Setting Powered False 12:28:33.092741 run create_hlr_db(pid=22133): Terminated: ok {rc=0} 12:28:33.563271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22135): Launched 12:28:33.885284 run osmo-hlr_10.42.42.2(pid=22136): Launched 12:28:34.007304 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:34.559876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22138): Launched 12:28:34.881300 run osmo-stp_10.42.42.5(pid=22139): Launched 12:28:35.003524 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:35.586685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22141): Launched 12:28:35.907751 run osmo-msc_10.42.42.6(pid=22142): Launched 12:28:36.085824 run osmo-stp_10.42.42.5(pid=22139): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22139)] 12:28:36.221135 run osmo-stp_10.42.42.5(pid=22139): stdout: | (launched: 2022-12-14_12:28:34.821625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:36.357048 run osmo-stp_10.42.42.5(pid=22139): stderr: | [0;m[38;5;43m20221214122835015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122835015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122835015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122835016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122835016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122835016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122835016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:36.491547 run osmo-stp_10.42.42.5(pid=22139): stdout: | (launched: 2022-12-14_12:28:34.821625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:36.618442 run osmo-stp_10.42.42.5(pid=22139): stderr: | [0;m[38;5;43m20221214122835015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122835015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122835015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122835016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122835016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122835016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122835016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:36.770513 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22139): Process ended prematurely: osmo-stp_10.42.42.5(pid=22139) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22139)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:28:36.780022 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:28:36.807649 run osmo-hlr_10.42.42.2(pid=22136): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22136)] 12:28:36.857402 run osmo-hlr_10.42.42.2(pid=22136): stdout: | (launched: 2022-12-14_12:28:33.825912) 12:28:36.909093 run osmo-hlr_10.42.42.2(pid=22136): stderr: | [0;m[1;31m20221214122834023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122834023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122834023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122834023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122834023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122834024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122834035 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122834044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122834044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122834044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:36.980796 run osmo-msc_10.42.42.6(pid=22142): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22142)] 12:28:37.030436 run osmo-msc_10.42.42.6(pid=22142): stdout: | (launched: 2022-12-14_12:28:35.848530) 12:28:37.081647 run osmo-msc_10.42.42.6(pid=22142): stderr: | [0;m[38;5;43m20221214122836169 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122836170 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11984f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122836170 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122836170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122836170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122836170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122836172 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122836172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122836172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122836172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:37.133307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22135): Terminating (SIGTERM) 12:28:37.174731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22138): Terminating (SIGTERM) 12:28:37.216191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22141): Terminating (SIGTERM) 12:28:37.258542 --- ParallelTerminationStrategy: PID 22135 died... 12:28:37.278433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22135): Terminated: ok {rc=0} 12:28:37.324373 --- ParallelTerminationStrategy: PID 22138 died... 12:28:37.343835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22138): Terminated: ok {rc=0} 12:28:37.389292 --- ParallelTerminationStrategy: PID 22141 died... 12:28:37.408462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22141): Terminated: ok {rc=0} 12:28:37.495349 bus /sierra_3: Setting Powered False 12:28:38.594062 bus /sierra_3: Setting Powered False 12:28:39.711516 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:28:40.948697 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:28:40.956060 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:28:40.979601 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:28:41.007319 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:28:41.059582 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:28:41.085755 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:28:41.114067 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:28:41.661285 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:28:41.710307 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:41.721549 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:28:41.781194 tst mo_mt_call.py: using LAC 40901 12:28:41.899847 tst mo_mt_call.py: using RAC 101 12:28:42.024222 tst mo_mt_call.py: using CellId 40901 12:28:42.141102 tst mo_mt_call.py: using BVCI 40902 12:28:42.249308 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:42.260434 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:42.271561 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:42.282587 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:42.293988 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:42.305340 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:42.426354 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:42.543866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:43.008449 run create_hlr_db(pid=22147): Launched 12:28:43.122770 bus /sierra_2: Setting Powered False 12:28:44.182294 run create_hlr_db(pid=22147): Terminated: ok {rc=0} 12:28:44.622364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22149): Launched 12:28:44.943950 run osmo-hlr_10.42.42.2(pid=22150): Launched 12:28:45.066036 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:45.625217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22152): Launched 12:28:45.960824 run osmo-stp_10.42.42.5(pid=22153): Launched 12:28:46.194514 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:46.936761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22155): Launched 12:28:47.256396 run osmo-msc_10.42.42.6(pid=22156): Launched 12:28:47.425274 run osmo-stp_10.42.42.5(pid=22153): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22153)] 12:28:47.553168 run osmo-stp_10.42.42.5(pid=22153): stdout: | (launched: 2022-12-14_12:28:45.894825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:47.682171 run osmo-stp_10.42.42.5(pid=22153): stderr: | [0;m[38;5;43m20221214122846232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122846232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122846232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122846242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122846245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122846245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122846245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:47.807376 run osmo-stp_10.42.42.5(pid=22153): stdout: | (launched: 2022-12-14_12:28:45.894825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:47.927134 run osmo-stp_10.42.42.5(pid=22153): stderr: | [0;m[38;5;43m20221214122846232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122846232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122846232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122846242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122846245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122846245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122846245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:48.068927 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22153): Process ended prematurely: osmo-stp_10.42.42.5(pid=22153) [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22153)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:28:48.078017 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:28:48.104259 run osmo-hlr_10.42.42.2(pid=22150): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22150)] 12:28:48.152322 run osmo-hlr_10.42.42.2(pid=22150): stdout: | (launched: 2022-12-14_12:28:44.884650) 12:28:48.201350 run osmo-hlr_10.42.42.2(pid=22150): stderr: | [0;m[1;31m20221214122845084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122845084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122845084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122845084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122845084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122845084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122845096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122845106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122845106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122845107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:48.270548 run osmo-msc_10.42.42.6(pid=22156): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22156)] 12:28:48.318048 run osmo-msc_10.42.42.6(pid=22156): stdout: | (launched: 2022-12-14_12:28:47.200717) 12:28:48.367053 run osmo-msc_10.42.42.6(pid=22156): stderr: | [0;m[38;5;43m20221214122847468 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122847468 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61c8a7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122847468 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122847468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122847468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122847469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122847470 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122847471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122847471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122847471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:48.416215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22149): Terminating (SIGTERM) 12:28:48.455604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22152): Terminating (SIGTERM) 12:28:48.494977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22155): Terminating (SIGTERM) 12:28:48.534603 --- ParallelTerminationStrategy: PID 22149 died... 12:28:48.553722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22149): Terminated: ok {rc=0} 12:28:48.597268 --- ParallelTerminationStrategy: PID 22152 died... 12:28:48.615929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22152): Terminated: ok {rc=0} 12:28:48.659196 --- ParallelTerminationStrategy: PID 22155 died... 12:28:48.677943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22155): Terminated: ok {rc=0} 12:28:48.763561 bus /sierra_3: Setting Powered False 12:28:49.860835 bus /sierra_3: Setting Powered False 12:28:50.971878 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:28:52.119405 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:52.131747 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:28:52.193990 tst mo_mt_call_osmux.py: using LAC 40902 12:28:52.321777 tst mo_mt_call_osmux.py: using RAC 102 12:28:52.448355 tst mo_mt_call_osmux.py: using CellId 40902 12:28:52.573902 tst mo_mt_call_osmux.py: using BVCI 40903 12:28:52.690419 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:52.702261 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:52.713826 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:52.725369 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:52.737054 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:28:52.748614 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:52.867897 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:28:52.985066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:53.448102 run create_hlr_db(pid=22158): Launched 12:28:53.562830 bus /sierra_2: Setting Powered False 12:28:54.622519 run create_hlr_db(pid=22158): Terminated: ok {rc=0} 12:28:55.039666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22160): Launched 12:28:55.338670 run osmo-hlr_10.42.42.2(pid=22161): Launched 12:28:55.451656 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:55.978189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22163): Launched 12:28:56.277330 run osmo-stp_10.42.42.5(pid=22164): Launched 12:28:56.391647 run osmo-msc_10.42.42.6: Starting osmo-msc 12:28:56.935380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22166): Launched 12:28:57.234384 run osmo-msc_10.42.42.6(pid=22167): Launched 12:28:57.401652 run osmo-stp_10.42.42.5(pid=22164): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22164)] 12:28:57.529562 run osmo-stp_10.42.42.5(pid=22164): stdout: | (launched: 2022-12-14_12:28:56.221438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:57.656340 run osmo-stp_10.42.42.5(pid=22164): stderr: | [0;m[38;5;43m20221214122856392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122856392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122856392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122856393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122856393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122856393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122856393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:57.780909 run osmo-stp_10.42.42.5(pid=22164): stdout: | (launched: 2022-12-14_12:28:56.221438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:57.899465 run osmo-stp_10.42.42.5(pid=22164): stderr: | [0;m[38;5;43m20221214122856392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122856392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122856392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122856393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122856393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122856393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122856393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:58.041672 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22164): Process ended prematurely: osmo-stp_10.42.42.5(pid=22164) [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22164)] [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:28:58.050399 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:28:58.076598 run osmo-hlr_10.42.42.2(pid=22161): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22161)] 12:28:58.124504 run osmo-hlr_10.42.42.2(pid=22161): stdout: | (launched: 2022-12-14_12:28:55.282833) 12:28:58.173824 run osmo-hlr_10.42.42.2(pid=22161): stderr: | [0;m[1;31m20221214122855459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122855459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122855459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122855459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122855459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122855459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122855471 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122855479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122855480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122855480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:58.242876 run osmo-msc_10.42.42.6(pid=22167): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22167)] 12:28:58.290028 run osmo-msc_10.42.42.6(pid=22167): stdout: | (launched: 2022-12-14_12:28:57.178797) 12:28:58.339350 run osmo-msc_10.42.42.6(pid=22167): stderr: | [0;m[38;5;43m20221214122857449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122857449 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9ecb2a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122857449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122857449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122857450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122857450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122857451 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122857452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122857452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122857452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:28:58.388793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22160): Terminating (SIGTERM) 12:28:58.428211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22163): Terminating (SIGTERM) 12:28:58.467526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22166): Terminating (SIGTERM) 12:28:58.507680 --- ParallelTerminationStrategy: PID 22160 died... 12:28:58.527289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22160): Terminated: ok {rc=0} 12:28:58.570861 --- ParallelTerminationStrategy: PID 22163 died... 12:28:58.589383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22163): Terminated: ok {rc=0} 12:28:58.632469 --- ParallelTerminationStrategy: PID 22166 died... 12:28:58.651201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22166): Terminated: ok {rc=0} 12:28:58.736065 bus /sierra_3: Setting Powered False 12:28:59.832837 bus /sierra_3: Setting Powered False 12:29:00.944262 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 emergency:nanobts+band-1900 --------------------------------------------------------------------- 12:29:02.192271 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:29:02.197829 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:29:02.221676 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:29:02.253007 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 12:29:02.342107 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:29:02.367174 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:29:02.394756 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 12:29:02.980821 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2404 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 12:29:02.986301 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:02.997580 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:29:03.037041 tst emergency_mo_mt_call.py: using LAC 40903 12:29:03.159696 tst emergency_mo_mt_call.py: using RAC 103 12:29:03.282666 tst emergency_mo_mt_call.py: using CellId 40903 12:29:03.407582 tst emergency_mo_mt_call.py: using BVCI 40904 12:29:03.521014 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:03.532361 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:03.543526 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:03.554479 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:03.565609 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:03.576530 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:03.693306 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:03.812935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:04.266762 run create_hlr_db(pid=22172): Launched 12:29:04.378602 bus /sierra_2: Setting Powered False 12:29:05.437254 run create_hlr_db(pid=22172): Terminated: ok {rc=0} 12:29:05.868877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22174): Launched 12:29:06.183710 run osmo-hlr_10.42.42.2(pid=22175): Launched 12:29:06.303266 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:06.845727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22177): Launched 12:29:07.159233 run osmo-stp_10.42.42.5(pid=22178): Launched 12:29:07.287006 tst emergency_mo_mt_call.py: using MSISDN 8679 12:29:07.446672 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:08.011981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22180): Launched 12:29:08.325545 run osmo-msc_10.42.42.6(pid=22181): Launched 12:29:08.500380 run osmo-stp_10.42.42.5(pid=22178): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22178)] 12:29:08.632310 run osmo-stp_10.42.42.5(pid=22178): stdout: | (launched: 2022-12-14_12:29:07.101124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:08.765413 run osmo-stp_10.42.42.5(pid=22178): stderr: | [0;m[38;5;43m20221214122907295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122907296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122907296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122907296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122907297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122907297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122907297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:08.897810 run osmo-stp_10.42.42.5(pid=22178): stdout: | (launched: 2022-12-14_12:29:07.101124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:09.022562 run osmo-stp_10.42.42.5(pid=22178): stderr: | [0;m[38;5;43m20221214122907295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122907296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122907296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122907296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122907297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122907297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122907297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:09.171638 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22178): Process ended prematurely: osmo-stp_10.42.42.5(pid=22178) [trial-2404↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22178)] [trial-2404↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 12:29:09.180803 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 12:29:09.208026 run osmo-hlr_10.42.42.2(pid=22175): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22175)] 12:29:09.257990 run osmo-hlr_10.42.42.2(pid=22175): stdout: | (launched: 2022-12-14_12:29:06.125570) 12:29:09.309547 run osmo-hlr_10.42.42.2(pid=22175): stderr: | [0;m[1;31m20221214122906326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122906326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122906327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122906327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122906327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122906327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122906337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122906345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122906346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122906346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:09.381134 run osmo-msc_10.42.42.6(pid=22181): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22181)] 12:29:09.430331 run osmo-msc_10.42.42.6(pid=22181): stdout: | (launched: 2022-12-14_12:29:08.267288) 12:29:09.481081 run osmo-msc_10.42.42.6(pid=22181): stderr: | [0;m[38;5;43m20221214122908589 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122908589 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f845f64cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122908589 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122908589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122908590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122908590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122908592 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122908592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122908592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122908592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:09.532058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22174): Terminating (SIGTERM) 12:29:09.573267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22177): Terminating (SIGTERM) 12:29:09.614605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22180): Terminating (SIGTERM) 12:29:09.656602 --- ParallelTerminationStrategy: PID 22174 died... 12:29:09.676467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22174): Terminated: ok {rc=0} 12:29:09.721730 --- ParallelTerminationStrategy: PID 22177 died... 12:29:09.740862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22177): Terminated: ok {rc=0} 12:29:09.786361 --- ParallelTerminationStrategy: PID 22180 died... 12:29:09.805698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22180): Terminated: ok {rc=0} 12:29:09.891251 bus /sierra_3: Setting Powered False 12:29:10.989033 bus /sierra_3: Setting Powered False 12:29:12.101418 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 12:29:13.189213 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:13.200752 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:29:13.241383 tst emergency_preemptive_call.py: using LAC 40904 12:29:13.356183 tst emergency_preemptive_call.py: using RAC 104 12:29:13.473926 tst emergency_preemptive_call.py: using CellId 40904 12:29:13.587836 tst emergency_preemptive_call.py: using BVCI 40905 12:29:13.693127 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:13.703846 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:13.714581 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:13.725080 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:13.735940 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:29:13.747322 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:13.860159 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:13.980076 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:14.096553 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:14.214058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:14.671654 run create_hlr_db(pid=22183): Launched 12:29:14.783777 bus /sierra_2: Setting Powered False 12:29:15.844413 run create_hlr_db(pid=22183): Terminated: ok {rc=0} 12:29:16.281696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22185): Launched 12:29:16.595433 run osmo-hlr_10.42.42.2(pid=22186): Launched 12:29:16.712225 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:17.443110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22188): Launched 12:29:17.736799 run osmo-stp_10.42.42.5(pid=22189): Launched 12:29:17.856523 tst emergency_preemptive_call.py: using MSISDN 8680 12:29:18.020112 run osmo-msc_10.42.42.6: Starting osmo-msc 12:29:18.548591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22191): Launched 12:29:18.842633 run osmo-msc_10.42.42.6(pid=22192): Launched 12:29:19.007712 run osmo-stp_10.42.42.5(pid=22189): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22189)] 12:29:19.133254 run osmo-stp_10.42.42.5(pid=22189): stdout: | (launched: 2022-12-14_12:29:17.681494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:19.259032 run osmo-stp_10.42.42.5(pid=22189): stderr: | [0;m[38;5;43m20221214122917851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122917851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122917852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122917854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122917854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122917854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122917854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:19.382168 run osmo-stp_10.42.42.5(pid=22189): stdout: | (launched: 2022-12-14_12:29:17.681494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:19.499135 run osmo-stp_10.42.42.5(pid=22189): stderr: | [0;m[38;5;43m20221214122917851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122917851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122917852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122917854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122917854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122917854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122917854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:19.639631 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22189): Process ended prematurely: osmo-stp_10.42.42.5(pid=22189) [trial-2404↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22189)] [trial-2404↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 12:29:19.648129 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 12:29:19.674328 run osmo-hlr_10.42.42.2(pid=22186): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22186)] 12:29:19.722498 run osmo-hlr_10.42.42.2(pid=22186): stdout: | (launched: 2022-12-14_12:29:16.537591) 12:29:19.771881 run osmo-hlr_10.42.42.2(pid=22186): stderr: | [0;m[1;31m20221214122916912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122916912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122916913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122916913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122916914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122916914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122916941 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122916966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122916966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122916967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:19.841139 run osmo-msc_10.42.42.6(pid=22192): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22192)] 12:29:19.888302 run osmo-msc_10.42.42.6(pid=22192): stdout: | (launched: 2022-12-14_12:29:18.787873) 12:29:19.937304 run osmo-msc_10.42.42.6(pid=22192): stderr: | [0;m[38;5;43m20221214122919056 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214122919056 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff78553dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214122919056 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214122919056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214122919056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214122919056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214122919058 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214122919059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214122919059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214122919059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:29:19.986909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22185): Terminating (SIGTERM) 12:29:20.026625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22188): Terminating (SIGTERM) 12:29:20.066378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22191): Terminating (SIGTERM) 12:29:20.106343 --- ParallelTerminationStrategy: PID 22185 died... 12:29:20.125869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22185): Terminated: ok {rc=0} 12:29:20.169817 --- ParallelTerminationStrategy: PID 22188 died... 12:29:20.188648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22188): Terminated: ok {rc=0} 12:29:20.232461 --- ParallelTerminationStrategy: PID 22191 died... 12:29:20.251516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22191): Terminated: ok {rc=0} 12:29:20.336889 bus /sierra_9: Setting Powered False 12:29:21.435899 bus /sierra_9: Setting Powered False 12:29:22.551874 bus /sierra_8: Setting Powered False 12:29:23.650395 bus /sierra_8: Setting Powered False 12:29:24.763202 bus /sierra_3: Setting Powered False 12:29:25.861333 bus /sierra_3: Setting Powered False 12:29:26.977187 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-1900 --------------------------------------------------------------------- 12:29:28.252603 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:29:28.258265 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:29:28.282718 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 12:29:28.322397 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 12:29:28.414407 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:29:28.439036 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 12:29:28.477938 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 12:29:29.067271 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 12:29:29.119111 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:29.130281 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:29:29.167821 tst cs_paging_gprs_active.py: using LAC 40905 12:29:29.292126 tst cs_paging_gprs_active.py: using RAC 105 12:29:29.415884 tst cs_paging_gprs_active.py: using CellId 40905 12:29:29.539644 tst cs_paging_gprs_active.py: using BVCI 40906 12:29:29.655651 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:29.666914 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:29.677898 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:29.688729 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:29.699724 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:29.710643 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:29.721741 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:29.732552 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:29.743618 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:29.858972 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:29.978755 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:29:30.195209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:30.518643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22197): Launched 12:29:30.799242 run iperf3-srv_10.42.42.10(pid=22198): Launched 12:29:30.931382 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:29:31.139152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:31.457742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22199): Launched 12:29:31.746737 run iperf3-srv_10.42.42.10(pid=22200): Launched 12:29:31.875372 tst cs_paging_gprs_active.py:38: start network... 12:29:32.094022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:32.604692 run create_hlr_db(pid=22201): Launched 12:29:32.735347 bus /sierra_2: Setting Powered False 12:29:33.799144 run create_hlr_db(pid=22201): Terminated: ok {rc=0} 12:29:34.229256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22203): Launched 12:29:34.530327 run osmo-hlr_10.42.42.2(pid=22204): Launched 12:29:34.645728 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:35.181428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22206): Launched 12:29:35.483057 run osmo-stp_10.42.42.5(pid=22207): Launched 12:29:35.598170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:29:36.117643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22209): Launched 12:29:36.232793 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:29:36.488490 run patchelf(pid=22210): Launched 12:29:36.657459 run osmo-stp_10.42.42.5(pid=22207): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22207)] 12:29:36.785201 run osmo-stp_10.42.42.5(pid=22207): stdout: | (launched: 2022-12-14_12:29:35.427029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:36.914823 run osmo-stp_10.42.42.5(pid=22207): stderr: | [0;m[38;5;43m20221214122935597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122935597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122935597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122935598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122935598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122935598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122935598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:37.044517 run osmo-stp_10.42.42.5(pid=22207): stdout: | (launched: 2022-12-14_12:29:35.427029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:37.168443 run osmo-stp_10.42.42.5(pid=22207): stderr: | [0;m[38;5;43m20221214122935597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122935597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122935597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122935598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122935598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122935598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122935598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:37.315145 run patchelf(pid=22210): Terminating (SIGINT) 12:29:37.484487 run patchelf(pid=22210): Terminated: ok {rc=0} 12:29:37.606483 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22207): Process ended prematurely: osmo-stp_10.42.42.5(pid=22207) [trial-2404↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22207)] [trial-2404↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 12:29:37.615795 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 12:29:37.642883 run osmo-hlr_10.42.42.2(pid=22204): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22204)] 12:29:37.690918 run osmo-hlr_10.42.42.2(pid=22204): stdout: | (launched: 2022-12-14_12:29:34.474443) 12:29:37.740407 run osmo-hlr_10.42.42.2(pid=22204): stderr: | [0;m[1;31m20221214122934650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122934650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122934650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122934650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122934650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122934650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122934664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122934674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122934674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122934674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:37.790018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22197): Terminating (SIGTERM) 12:29:37.830187 run iperf3-srv_10.42.42.10(pid=22198): Terminating (SIGTERM) 12:29:37.870177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22199): Terminating (SIGTERM) 12:29:37.910185 run iperf3-srv_10.42.42.10(pid=22200): Terminating (SIGTERM) 12:29:37.950114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22203): Terminating (SIGTERM) 12:29:37.990198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22206): Terminating (SIGTERM) 12:29:38.030017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22209): Terminating (SIGTERM) 12:29:38.070192 --- ParallelTerminationStrategy: PID 22197 died... 12:29:38.089914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22197): Terminated: ok {rc=0} 12:29:38.134102 --- ParallelTerminationStrategy: PID 22198 died... 12:29:38.152677 run iperf3-srv_10.42.42.10(pid=22198): Terminated {rc=256} 12:29:38.196707 --- ParallelTerminationStrategy: PID 22199 died... 12:29:38.215783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22199): Terminated: ok {rc=0} 12:29:38.259629 --- ParallelTerminationStrategy: PID 22200 died... 12:29:38.278612 run iperf3-srv_10.42.42.10(pid=22200): Terminated {rc=256} 12:29:38.322647 --- ParallelTerminationStrategy: PID 22203 died... 12:29:38.341728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22203): Terminated: ok {rc=0} 12:29:38.385579 --- ParallelTerminationStrategy: PID 22206 died... 12:29:38.404456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22206): Terminated: ok {rc=0} 12:29:38.448709 --- ParallelTerminationStrategy: PID 22209 died... 12:29:38.467897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22209): Terminated: ok {rc=0} 12:29:38.552908 bus /gobi_0: Setting Powered False 12:29:39.651527 bus /gobi_0: Setting Powered False 12:29:40.769425 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 12:29:41.917552 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:41.929319 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:29:41.967298 tst iperf3.py: using LAC 40906 12:29:42.094735 tst iperf3.py: using RAC 106 12:29:42.218475 tst iperf3.py: using CellId 40906 12:29:42.342754 tst iperf3.py: using BVCI 40907 12:29:42.460276 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:42.471540 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:42.482766 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:42.493806 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:42.504651 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:42.515578 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:42.526867 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:42.537890 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:42.548877 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:42.670590 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:29:42.887232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:43.210291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22211): Launched 12:29:43.491011 run iperf3-srv_10.42.42.10(pid=22212): Launched 12:29:43.610948 tst iperf3.py:8: start network... 12:29:43.827099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:44.326004 run create_hlr_db(pid=22213): Launched 12:29:44.454292 bus /gobi_6: Setting Powered False 12:29:45.513890 run create_hlr_db(pid=22213): Terminated: ok {rc=0} 12:29:45.973680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22215): Launched 12:29:46.292447 run osmo-hlr_10.42.42.2(pid=22216): Launched 12:29:46.495359 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:47.121716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22218): Launched 12:29:47.437523 run osmo-stp_10.42.42.5(pid=22219): Launched 12:29:47.553614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:29:48.084854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22221): Launched 12:29:48.199704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:29:48.455073 run patchelf(pid=22222): Launched 12:29:48.622433 run osmo-stp_10.42.42.5(pid=22219): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22219)] 12:29:48.750465 run osmo-stp_10.42.42.5(pid=22219): stdout: | (launched: 2022-12-14_12:29:47.377430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:48.879762 run osmo-stp_10.42.42.5(pid=22219): stderr: | [0;m[38;5;43m20221214122947554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122947554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122947554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122947555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122947555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122947555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122947555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:49.008586 run osmo-stp_10.42.42.5(pid=22219): stdout: | (launched: 2022-12-14_12:29:47.377430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:49.131973 run osmo-stp_10.42.42.5(pid=22219): stderr: | [0;m[38;5;43m20221214122947554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122947554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122947554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122947555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122947555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122947555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122947555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:49.277989 run patchelf(pid=22222): Terminating (SIGINT) 12:29:49.446999 run patchelf(pid=22222): Terminated: ok {rc=0} 12:29:49.569078 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22219): Process ended prematurely: osmo-stp_10.42.42.5(pid=22219) [trial-2404↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22219)] [trial-2404↪gprs:nanobts+band-1900↪iperf3.py:8] 12:29:49.578642 tst iperf3.py:8: Test FAILED (7.7 sec) 12:29:49.605699 run osmo-hlr_10.42.42.2(pid=22216): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22216)] 12:29:49.653780 run osmo-hlr_10.42.42.2(pid=22216): stdout: | (launched: 2022-12-14_12:29:46.229123) 12:29:49.703150 run osmo-hlr_10.42.42.2(pid=22216): stderr: | [0;m[1;31m20221214122946590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122946590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122946590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122946590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122946590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122946590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122946612 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122946625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122946625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122946625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:49.752935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22211): Terminating (SIGTERM) 12:29:49.793139 run iperf3-srv_10.42.42.10(pid=22212): Terminating (SIGTERM) 12:29:49.833132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22215): Terminating (SIGTERM) 12:29:49.873249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22218): Terminating (SIGTERM) 12:29:49.913200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22221): Terminating (SIGTERM) 12:29:49.953472 --- ParallelTerminationStrategy: PID 22211 died... 12:29:49.973043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22211): Terminated: ok {rc=0} 12:29:50.017402 --- ParallelTerminationStrategy: PID 22212 died... 12:29:50.036326 run iperf3-srv_10.42.42.10(pid=22212): Terminated {rc=256} 12:29:50.080423 --- ParallelTerminationStrategy: PID 22215 died... 12:29:50.099503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22215): Terminated: ok {rc=0} 12:29:50.143396 --- ParallelTerminationStrategy: PID 22218 died... 12:29:50.162491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22218): Terminated: ok {rc=0} 12:29:50.206370 --- ParallelTerminationStrategy: PID 22221 died... 12:29:50.225427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22221): Terminated: ok {rc=0} 12:29:50.311398 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 12:29:51.457418 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:51.468904 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:29:51.508646 tst iperf3m4.py: using LAC 40907 12:29:51.628226 tst iperf3m4.py: using RAC 107 12:29:51.747097 tst iperf3m4.py: using CellId 40907 12:29:51.866787 tst iperf3m4.py: using BVCI 40908 12:29:51.976930 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:51.987686 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:51.998387 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:52.008846 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:52.019857 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:52.030640 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:52.041634 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:52.053219 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:29:52.064227 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:52.185701 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:52.307979 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:52.425508 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:29:52.542340 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:29:52.743387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:53.047685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22223): Launched 12:29:53.311017 run iperf3-srv_10.42.42.10(pid=22224): Launched 12:29:53.423172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:29:53.622594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:53.924878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22225): Launched 12:29:54.188362 run iperf3-srv_10.42.42.10(pid=22226): Launched 12:29:54.301105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:29:54.501101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:54.804884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22227): Launched 12:29:55.067316 run iperf3-srv_10.42.42.10(pid=22228): Launched 12:29:55.179733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:29:55.379105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:55.681551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22229): Launched 12:29:55.944591 run iperf3-srv_10.42.42.10(pid=22230): Launched 12:29:56.056782 tst iperf3m4.py:8: start network... 12:29:56.257062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:56.722007 run create_hlr_db(pid=22231): Launched 12:29:56.835650 bus /gobi_6: Setting Powered False 12:29:57.894926 run create_hlr_db(pid=22231): Terminated: ok {rc=0} 12:29:58.335202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22233): Launched 12:29:58.659621 run osmo-hlr_10.42.42.2(pid=22234): Launched 12:29:58.781880 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:59.335278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22236): Launched 12:29:59.659177 run osmo-stp_10.42.42.5(pid=22237): Launched 12:29:59.780514 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:00.334590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22239): Launched 12:30:00.459455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:00.732142 run patchelf(pid=22240): Launched 12:30:00.934666 run osmo-stp_10.42.42.5(pid=22237): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22237)] 12:30:01.067883 run osmo-stp_10.42.42.5(pid=22237): stdout: | (launched: 2022-12-14_12:29:59.598236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:01.201388 run osmo-stp_10.42.42.5(pid=22237): stderr: | [0;m[38;5;43m20221214122959787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122959788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122959788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122959788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122959789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122959789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122959789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:01.336127 run osmo-stp_10.42.42.5(pid=22237): stdout: | (launched: 2022-12-14_12:29:59.598236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:01.466243 run osmo-stp_10.42.42.5(pid=22237): stderr: | [0;m[38;5;43m20221214122959787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214122959788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214122959788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214122959788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214122959789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214122959789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214122959789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:01.619152 run patchelf(pid=22240): Terminating (SIGINT) 12:30:01.802275 run patchelf(pid=22240): Terminated: ok {rc=0} 12:30:01.929837 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22237): Process ended prematurely: osmo-stp_10.42.42.5(pid=22237) [trial-2404↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22237)] [trial-2404↪gprs:nanobts+band-1900↪iperf3m4.py:8] 12:30:01.941033 tst iperf3m4.py:8: Test FAILED (10.5 sec) 12:30:01.969315 run osmo-hlr_10.42.42.2(pid=22234): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22234)] 12:30:02.020338 run osmo-hlr_10.42.42.2(pid=22234): stdout: | (launched: 2022-12-14_12:29:58.599358) 12:30:02.074009 run osmo-hlr_10.42.42.2(pid=22234): stderr: | [0;m[1;31m20221214122958794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214122958794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214122958794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214122958794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214122958794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214122958794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214122958808 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214122958816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214122958816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214122958816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:02.126106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22223): Terminating (SIGTERM) 12:30:02.167281 run iperf3-srv_10.42.42.10(pid=22224): Terminating (SIGTERM) 12:30:02.210606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22225): Terminating (SIGTERM) 12:30:02.252026 run iperf3-srv_10.42.42.10(pid=22226): Terminating (SIGTERM) 12:30:02.294565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22227): Terminating (SIGTERM) 12:30:02.336479 run iperf3-srv_10.42.42.10(pid=22228): Terminating (SIGTERM) 12:30:02.377948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22229): Terminating (SIGTERM) 12:30:02.419453 run iperf3-srv_10.42.42.10(pid=22230): Terminating (SIGTERM) 12:30:02.460565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22233): Terminating (SIGTERM) 12:30:02.502169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22236): Terminating (SIGTERM) 12:30:02.543621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22239): Terminating (SIGTERM) 12:30:02.585654 --- ParallelTerminationStrategy: PID 22223 died... 12:30:02.605106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22223): Terminated: ok {rc=0} 12:30:02.651120 --- ParallelTerminationStrategy: PID 22224 died... 12:30:02.670679 run iperf3-srv_10.42.42.10(pid=22224): Terminated {rc=256} 12:30:02.716179 --- ParallelTerminationStrategy: PID 22225 died... 12:30:02.735651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22225): Terminated: ok {rc=0} 12:30:02.781313 --- ParallelTerminationStrategy: PID 22226 died... 12:30:02.800776 run iperf3-srv_10.42.42.10(pid=22226): Terminated {rc=256} 12:30:02.846930 --- ParallelTerminationStrategy: PID 22227 died... 12:30:02.866733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22227): Terminated: ok {rc=0} 12:30:02.912432 --- ParallelTerminationStrategy: PID 22228 died... 12:30:02.931945 run iperf3-srv_10.42.42.10(pid=22228): Terminated {rc=256} 12:30:02.977521 --- ParallelTerminationStrategy: PID 22229 died... 12:30:02.997326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22229): Terminated: ok {rc=0} 12:30:03.043057 --- ParallelTerminationStrategy: PID 22230 died... 12:30:03.062802 run iperf3-srv_10.42.42.10(pid=22230): Terminated {rc=256} 12:30:03.108442 --- ParallelTerminationStrategy: PID 22233 died... 12:30:03.127881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22233): Terminated: ok {rc=0} 12:30:03.173662 --- ParallelTerminationStrategy: PID 22236 died... 12:30:03.193326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22236): Terminated: ok {rc=0} 12:30:03.239078 --- ParallelTerminationStrategy: PID 22239 died... 12:30:03.258697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22239): Terminated: ok {rc=0} 12:30:03.346426 bus /gobi_4: Setting Powered False 12:30:04.444105 bus /gobi_4: Setting Powered False 12:30:05.560429 bus /gobi_1: Setting Powered False 12:30:06.658384 bus /gobi_1: Setting Powered False 12:30:07.773166 bus /gobi_0: Setting Powered False 12:30:08.870463 bus /gobi_0: Setting Powered False 12:30:09.988045 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 12:30:11.090869 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:11.102720 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:30:11.143500 tst ping.py: using LAC 40908 12:30:11.268543 tst ping.py: using RAC 108 12:30:11.385674 tst ping.py: using CellId 40908 12:30:11.503641 tst ping.py: using BVCI 40909 12:30:11.611832 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:11.622676 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:11.633440 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:11.644087 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:11.655545 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:11.666944 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:11.678306 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:11.689724 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:30:11.807817 tst ping.py:19: start network... 12:30:12.019480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:12.507575 run create_hlr_db(pid=22244): Launched 12:30:12.635420 bus /gobi_6: Setting Powered False 12:30:13.697995 run create_hlr_db(pid=22244): Terminated: ok {rc=0} 12:30:14.138499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22246): Launched 12:30:14.453329 run osmo-hlr_10.42.42.2(pid=22247): Launched 12:30:14.567950 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:15.084317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22249): Launched 12:30:15.379319 run osmo-stp_10.42.42.5(pid=22250): Launched 12:30:15.490578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:16.010510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22252): Launched 12:30:16.137743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:16.396403 run patchelf(pid=22253): Launched 12:30:16.579358 run osmo-stp_10.42.42.5(pid=22250): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22250)] 12:30:16.708278 run osmo-stp_10.42.42.5(pid=22250): stdout: | (launched: 2022-12-14_12:30:15.324411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:16.839090 run osmo-stp_10.42.42.5(pid=22250): stderr: | [0;m[38;5;43m20221214123015495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123015495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123015495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123015496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123015496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123015496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123015496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:16.970380 run osmo-stp_10.42.42.5(pid=22250): stdout: | (launched: 2022-12-14_12:30:15.324411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:17.094864 run osmo-stp_10.42.42.5(pid=22250): stderr: | [0;m[38;5;43m20221214123015495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123015495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123015495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123015496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123015496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123015496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123015496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:17.242104 run patchelf(pid=22253): Terminating (SIGINT) 12:30:17.407994 run patchelf(pid=22253): Terminated: ok {rc=0} 12:30:17.527656 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22250): Process ended prematurely: osmo-stp_10.42.42.5(pid=22250) [trial-2404↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22250)] [trial-2404↪gprs:nanobts+band-1900↪ping.py:22] 12:30:17.536917 tst ping.py:22: Test FAILED (6.4 sec) 12:30:17.563753 run osmo-hlr_10.42.42.2(pid=22247): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22247)] 12:30:17.612110 run osmo-hlr_10.42.42.2(pid=22247): stdout: | (launched: 2022-12-14_12:30:14.395004) 12:30:17.661236 run osmo-hlr_10.42.42.2(pid=22247): stderr: | [0;m[1;31m20221214123014573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123014573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123014573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123014573 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123014574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123014574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123014585 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123014593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123014594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123014594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:17.710990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22246): Terminating (SIGTERM) 12:30:17.751017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22249): Terminating (SIGTERM) 12:30:17.791051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22252): Terminating (SIGTERM) 12:30:17.831844 --- ParallelTerminationStrategy: PID 22246 died... 12:30:17.851721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22246): Terminated: ok {rc=0} 12:30:17.895678 --- ParallelTerminationStrategy: PID 22249 died... 12:30:17.914745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22249): Terminated: ok {rc=0} 12:30:17.958847 --- ParallelTerminationStrategy: PID 22252 died... 12:30:17.977825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22252): Terminated: ok {rc=0} 12:30:18.063556 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 12:30:19.151220 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:19.162734 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:30:19.202318 tst ping_idle_ping.py: using LAC 40909 12:30:19.319354 tst ping_idle_ping.py: using RAC 109 12:30:19.435500 tst ping_idle_ping.py: using CellId 40909 12:30:19.552850 tst ping_idle_ping.py: using BVCI 40910 12:30:19.659957 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:19.670709 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:19.681373 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:19.691868 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:19.702627 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:19.713409 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:19.724248 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:30:19.735227 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:30:19.849965 tst ping_idle_ping.py:24: start network... 12:30:20.046978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:20.505822 run create_hlr_db(pid=22254): Launched 12:30:20.617576 bus /gobi_6: Setting Powered False 12:30:21.676867 run create_hlr_db(pid=22254): Terminated: ok {rc=0} 12:30:22.111651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22257): Launched 12:30:22.429894 run osmo-hlr_10.42.42.2(pid=22258): Launched 12:30:22.550263 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:23.096459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22260): Launched 12:30:23.414454 run osmo-stp_10.42.42.5(pid=22261): Launched 12:30:23.534789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:24.082036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22263): Launched 12:30:24.202206 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:24.470343 run patchelf(pid=22264): Launched 12:30:24.645564 run osmo-stp_10.42.42.5(pid=22261): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22261)] 12:30:24.779795 run osmo-stp_10.42.42.5(pid=22261): stdout: | (launched: 2022-12-14_12:30:23.355633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:24.915901 run osmo-stp_10.42.42.5(pid=22261): stderr: | [0;m[38;5;43m20221214123023548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123023549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123023549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123023549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123023550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123023550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123023550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:25.052511 run osmo-stp_10.42.42.5(pid=22261): stdout: | (launched: 2022-12-14_12:30:23.355633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:25.182252 run osmo-stp_10.42.42.5(pid=22261): stderr: | [0;m[38;5;43m20221214123023548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123023549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123023549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123023549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123023550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123023550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123023550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:25.336017 run patchelf(pid=22264): Terminating (SIGINT) 12:30:25.513654 run patchelf(pid=22264): Terminated: ok {rc=0} 12:30:25.641526 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22261): Process ended prematurely: osmo-stp_10.42.42.5(pid=22261) [trial-2404↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22261)] [trial-2404↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 12:30:25.651013 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:30:25.679073 run osmo-hlr_10.42.42.2(pid=22258): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22258)] 12:30:25.729593 run osmo-hlr_10.42.42.2(pid=22258): stdout: | (launched: 2022-12-14_12:30:22.371060) 12:30:25.781344 run osmo-hlr_10.42.42.2(pid=22258): stderr: | [0;m[1;31m20221214123022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123022570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123022571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123022584 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123022593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123022594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123022594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:25.833354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22257): Terminating (SIGTERM) 12:30:25.875442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22260): Terminating (SIGTERM) 12:30:25.917812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22263): Terminating (SIGTERM) 12:30:25.960149 --- ParallelTerminationStrategy: PID 22257 died... 12:30:25.980140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22257): Terminated: ok {rc=0} 12:30:26.026445 --- ParallelTerminationStrategy: PID 22260 died... 12:30:26.045995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22260): Terminated: ok {rc=0} 12:30:26.091181 --- ParallelTerminationStrategy: PID 22263 died... 12:30:26.110519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22263): Terminated: ok {rc=0} 12:30:26.197865 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 12:30:27.498585 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:30:27.505183 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:30:27.529545 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:30:27.568636 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:30:27.657382 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:30:27.681546 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:30:27.720479 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:30:28.319085 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:30:28.370475 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:28.381795 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:30:28.423303 tst cs_paging_gprs_active.py: using LAC 40910 12:30:28.550390 tst cs_paging_gprs_active.py: using RAC 110 12:30:28.677215 tst cs_paging_gprs_active.py: using CellId 40910 12:30:28.803721 tst cs_paging_gprs_active.py: using BVCI 40911 12:30:28.919623 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:28.931048 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:28.942189 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:28.953367 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:28.964425 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:28.975593 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:28.986943 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:28.998024 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:29.009254 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:29.130387 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:29.248221 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:30:29.448427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:29.749276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22268): Launched 12:30:30.011526 run iperf3-srv_10.42.42.10(pid=22269): Launched 12:30:30.123878 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:30:30.323402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:30.624707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22270): Launched 12:30:30.893780 run iperf3-srv_10.42.42.10(pid=22271): Launched 12:30:31.044925 tst cs_paging_gprs_active.py:38: start network... 12:30:31.284656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:31.801410 run create_hlr_db(pid=22272): Launched 12:30:31.965561 bus /gobi_6: Setting Powered False 12:30:33.030674 run create_hlr_db(pid=22272): Terminated: ok {rc=0} 12:30:33.460558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22274): Launched 12:30:33.761301 run osmo-hlr_10.42.42.2(pid=22275): Launched 12:30:33.875741 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:34.407614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22277): Launched 12:30:34.708407 run osmo-stp_10.42.42.5(pid=22278): Launched 12:30:34.822548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:35.341056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22280): Launched 12:30:35.456621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:35.712124 run patchelf(pid=22281): Launched 12:30:35.879681 run osmo-stp_10.42.42.5(pid=22278): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22278)] 12:30:36.007263 run osmo-stp_10.42.42.5(pid=22278): stdout: | (launched: 2022-12-14_12:30:34.652463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:36.136668 run osmo-stp_10.42.42.5(pid=22278): stderr: | [0;m[38;5;43m20221214123034822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123034822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123034822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123034823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123034823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123034823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123034823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:36.265951 run osmo-stp_10.42.42.5(pid=22278): stdout: | (launched: 2022-12-14_12:30:34.652463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:36.389792 run osmo-stp_10.42.42.5(pid=22278): stderr: | [0;m[38;5;43m20221214123034822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123034822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123034822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123034823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123034823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123034823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123034823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:36.536015 run patchelf(pid=22281): Terminating (SIGINT) 12:30:36.704335 run patchelf(pid=22281): Terminated: ok {rc=0} 12:30:36.825867 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22278): Process ended prematurely: osmo-stp_10.42.42.5(pid=22278) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22278)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:30:36.835374 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 12:30:36.862730 run osmo-hlr_10.42.42.2(pid=22275): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22275)] 12:30:36.910457 run osmo-hlr_10.42.42.2(pid=22275): stdout: | (launched: 2022-12-14_12:30:33.705076) 12:30:36.959522 run osmo-hlr_10.42.42.2(pid=22275): stderr: | [0;m[1;31m20221214123033882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123033882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123033882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123033882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123033882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123033883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123033895 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123033903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123033903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123033903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:37.009059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22268): Terminating (SIGTERM) 12:30:37.048888 run iperf3-srv_10.42.42.10(pid=22269): Terminating (SIGTERM) 12:30:37.088680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22270): Terminating (SIGTERM) 12:30:37.128515 run iperf3-srv_10.42.42.10(pid=22271): Terminating (SIGTERM) 12:30:37.168126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22274): Terminating (SIGTERM) 12:30:37.207979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22277): Terminating (SIGTERM) 12:30:37.247514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22280): Terminating (SIGTERM) 12:30:37.287413 --- ParallelTerminationStrategy: PID 22268 died... 12:30:37.306887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22268): Terminated: ok {rc=0} 12:30:37.350879 --- ParallelTerminationStrategy: PID 22269 died... 12:30:37.369582 run iperf3-srv_10.42.42.10(pid=22269): Terminated {rc=256} 12:30:37.413277 --- ParallelTerminationStrategy: PID 22270 died... 12:30:37.432118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22270): Terminated: ok {rc=0} 12:30:37.475821 --- ParallelTerminationStrategy: PID 22271 died... 12:30:37.494587 run iperf3-srv_10.42.42.10(pid=22271): Terminated {rc=256} 12:30:37.538093 --- ParallelTerminationStrategy: PID 22274 died... 12:30:37.556914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22274): Terminated: ok {rc=0} 12:30:37.600204 --- ParallelTerminationStrategy: PID 22277 died... 12:30:37.619004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22277): Terminated: ok {rc=0} 12:30:37.662401 --- ParallelTerminationStrategy: PID 22280 died... 12:30:37.681743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22280): Terminated: ok {rc=0} 12:30:37.767122 bus /gobi_0: Setting Powered False 12:30:38.865261 bus /gobi_0: Setting Powered False 12:30:39.977362 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:30:41.123984 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:41.136425 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:30:41.181078 tst iperf3.py: using LAC 40911 12:30:41.308319 tst iperf3.py: using RAC 111 12:30:41.433350 tst iperf3.py: using CellId 40911 12:30:41.560841 tst iperf3.py: using BVCI 40912 12:30:41.679020 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:41.690654 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:41.702195 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:41.713584 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:41.724799 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:41.735946 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:41.747301 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:41.758531 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:41.769893 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:41.891463 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:30:42.094234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:42.397584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22282): Launched 12:30:42.661807 run iperf3-srv_10.42.42.10(pid=22283): Launched 12:30:42.774694 tst iperf3.py:8: start network... 12:30:42.975500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:43.442065 run create_hlr_db(pid=22284): Launched 12:30:43.556752 bus /gobi_6: Setting Powered False 12:30:44.616920 run create_hlr_db(pid=22284): Terminated: ok {rc=0} 12:30:45.037039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22286): Launched 12:30:45.339521 run osmo-hlr_10.42.42.2(pid=22287): Launched 12:30:45.454390 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:46.022175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22289): Launched 12:30:46.383818 run osmo-stp_10.42.42.5(pid=22290): Launched 12:30:46.707804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:47.352122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22292): Launched 12:30:47.483483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:47.757146 run patchelf(pid=22293): Launched 12:30:47.935366 run osmo-stp_10.42.42.5(pid=22290): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22290)] 12:30:48.071755 run osmo-stp_10.42.42.5(pid=22290): stdout: | (launched: 2022-12-14_12:30:46.321567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:48.209832 run osmo-stp_10.42.42.5(pid=22290): stderr: | [0;m[38;5;43m20221214123046524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123046524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123046524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123046526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123046528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123046528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123046529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:48.348041 run osmo-stp_10.42.42.5(pid=22290): stdout: | (launched: 2022-12-14_12:30:46.321567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:48.480429 run osmo-stp_10.42.42.5(pid=22290): stderr: | [0;m[38;5;43m20221214123046524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123046524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123046524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123046526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123046528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123046528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123046529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:48.636220 run patchelf(pid=22293): Terminating (SIGINT) 12:30:48.816641 run patchelf(pid=22293): Terminated: ok {rc=0} 12:30:48.946969 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22290): Process ended prematurely: osmo-stp_10.42.42.5(pid=22290) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22290)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 12:30:48.957149 tst iperf3.py:8: Test FAILED (7.9 sec) 12:30:48.985601 run osmo-hlr_10.42.42.2(pid=22287): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22287)] 12:30:49.035475 run osmo-hlr_10.42.42.2(pid=22287): stdout: | (launched: 2022-12-14_12:30:45.283259) 12:30:49.087078 run osmo-hlr_10.42.42.2(pid=22287): stderr: | [0;m[1;31m20221214123045459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123045459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123045459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123045459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123045459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123045459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123045474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123045484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123045484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123045484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:49.139423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22282): Terminating (SIGTERM) 12:30:49.181770 run iperf3-srv_10.42.42.10(pid=22283): Terminating (SIGTERM) 12:30:49.224065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22286): Terminating (SIGTERM) 12:30:49.265804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22289): Terminating (SIGTERM) 12:30:49.308208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22292): Terminating (SIGTERM) 12:30:49.350933 --- ParallelTerminationStrategy: PID 22282 died... 12:30:49.370998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22282): Terminated: ok {rc=0} 12:30:49.417195 --- ParallelTerminationStrategy: PID 22283 died... 12:30:49.436761 run iperf3-srv_10.42.42.10(pid=22283): Terminated {rc=256} 12:30:49.482277 --- ParallelTerminationStrategy: PID 22286 died... 12:30:49.501651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22286): Terminated: ok {rc=0} 12:30:49.547038 --- ParallelTerminationStrategy: PID 22289 died... 12:30:49.566534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22289): Terminated: ok {rc=0} 12:30:49.612041 --- ParallelTerminationStrategy: PID 22292 died... 12:30:49.631488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22292): Terminated: ok {rc=0} 12:30:49.718410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:30:50.866371 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:50.878400 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:30:50.920553 tst iperf3m4.py: using LAC 40912 12:30:51.039560 tst iperf3m4.py: using RAC 112 12:30:51.166931 tst iperf3m4.py: using CellId 40912 12:30:51.294756 tst iperf3m4.py: using BVCI 40913 12:30:51.413051 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:51.424436 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:51.435642 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:51.446818 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:51.457892 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:51.468927 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:51.480710 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:51.491842 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:30:51.503175 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:51.620132 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:51.742780 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:51.859662 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:30:51.979364 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:30:52.187494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:52.490584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22295): Launched 12:30:52.753232 run iperf3-srv_10.42.42.10(pid=22296): Launched 12:30:52.865566 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:30:53.066649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:53.370150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22297): Launched 12:30:53.632637 run iperf3-srv_10.42.42.10(pid=22298): Launched 12:30:53.744909 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:30:53.945481 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:54.248355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22299): Launched 12:30:54.510848 run iperf3-srv_10.42.42.10(pid=22300): Launched 12:30:54.622930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:30:54.823254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:55.124914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22301): Launched 12:30:55.388221 run iperf3-srv_10.42.42.10(pid=22302): Launched 12:30:55.500363 tst iperf3m4.py:8: start network... 12:30:55.700426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:56.165060 run create_hlr_db(pid=22303): Launched 12:30:56.280121 bus /gobi_6: Setting Powered False 12:30:57.340704 run create_hlr_db(pid=22303): Terminated: ok {rc=0} 12:30:57.780630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22305): Launched 12:30:58.102540 run osmo-hlr_10.42.42.2(pid=22306): Launched 12:30:58.224791 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:58.785110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22308): Launched 12:30:59.106545 run osmo-stp_10.42.42.5(pid=22309): Launched 12:30:59.227920 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:59.784382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22311): Launched 12:30:59.907043 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:00.179596 run patchelf(pid=22312): Launched 12:31:00.359218 run osmo-stp_10.42.42.5(pid=22309): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22309)] 12:31:00.494810 run osmo-stp_10.42.42.5(pid=22309): stdout: | (launched: 2022-12-14_12:30:59.046699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:00.632053 run osmo-stp_10.42.42.5(pid=22309): stderr: | [0;m[38;5;43m20221214123059235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123059235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123059235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123059236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123059236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123059236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123059236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:00.769295 run osmo-stp_10.42.42.5(pid=22309): stdout: | (launched: 2022-12-14_12:30:59.046699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:00.901527 run osmo-stp_10.42.42.5(pid=22309): stderr: | [0;m[38;5;43m20221214123059235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123059235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123059235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123059236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123059236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123059236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123059236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:01.059949 run patchelf(pid=22312): Terminating (SIGINT) 12:31:01.242869 run patchelf(pid=22312): Terminated: ok {rc=0} 12:31:01.375460 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22309): Process ended prematurely: osmo-stp_10.42.42.5(pid=22309) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22309)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 12:31:01.386286 tst iperf3m4.py:8: Test FAILED (10.6 sec) 12:31:01.416098 run osmo-hlr_10.42.42.2(pid=22306): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22306)] 12:31:01.466615 run osmo-hlr_10.42.42.2(pid=22306): stdout: | (launched: 2022-12-14_12:30:58.042931) 12:31:01.518844 run osmo-hlr_10.42.42.2(pid=22306): stderr: | [0;m[1;31m20221214123058238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123058238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123058238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123058238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123058238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123058239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123058251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123058263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123058263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123058263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:01.571773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22295): Terminating (SIGTERM) 12:31:01.614416 run iperf3-srv_10.42.42.10(pid=22296): Terminating (SIGTERM) 12:31:01.659143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22297): Terminating (SIGTERM) 12:31:01.702071 run iperf3-srv_10.42.42.10(pid=22298): Terminating (SIGTERM) 12:31:01.747355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22299): Terminating (SIGTERM) 12:31:01.790158 run iperf3-srv_10.42.42.10(pid=22300): Terminating (SIGTERM) 12:31:01.834966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22301): Terminating (SIGTERM) 12:31:01.878003 run iperf3-srv_10.42.42.10(pid=22302): Terminating (SIGTERM) 12:31:01.923059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22305): Terminating (SIGTERM) 12:31:01.965450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22308): Terminating (SIGTERM) 12:31:02.007386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22311): Terminating (SIGTERM) 12:31:02.049714 --- ParallelTerminationStrategy: PID 22295 died... 12:31:02.069597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22295): Terminated: ok {rc=0} 12:31:02.115888 --- ParallelTerminationStrategy: PID 22296 died... 12:31:02.135873 run iperf3-srv_10.42.42.10(pid=22296): Terminated {rc=256} 12:31:02.181999 --- ParallelTerminationStrategy: PID 22297 died... 12:31:02.202135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22297): Terminated: ok {rc=0} 12:31:02.248047 --- ParallelTerminationStrategy: PID 22298 died... 12:31:02.267726 run iperf3-srv_10.42.42.10(pid=22298): Terminated {rc=256} 12:31:02.313187 --- ParallelTerminationStrategy: PID 22299 died... 12:31:02.332192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22299): Terminated: ok {rc=0} 12:31:02.377810 --- ParallelTerminationStrategy: PID 22300 died... 12:31:02.397057 run iperf3-srv_10.42.42.10(pid=22300): Terminated {rc=256} 12:31:02.442200 --- ParallelTerminationStrategy: PID 22301 died... 12:31:02.461596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22301): Terminated: ok {rc=0} 12:31:02.506660 --- ParallelTerminationStrategy: PID 22302 died... 12:31:02.525860 run iperf3-srv_10.42.42.10(pid=22302): Terminated {rc=256} 12:31:02.570918 --- ParallelTerminationStrategy: PID 22305 died... 12:31:02.590244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22305): Terminated: ok {rc=0} 12:31:02.635545 --- ParallelTerminationStrategy: PID 22308 died... 12:31:02.654895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22308): Terminated: ok {rc=0} 12:31:02.700549 --- ParallelTerminationStrategy: PID 22311 died... 12:31:02.720226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22311): Terminated: ok {rc=0} 12:31:02.807526 bus /gobi_4: Setting Powered False 12:31:03.903395 bus /gobi_4: Setting Powered False 12:31:05.019612 bus /gobi_1: Setting Powered False 12:31:06.117957 bus /gobi_1: Setting Powered False 12:31:07.233920 bus /gobi_0: Setting Powered False 12:31:08.332449 bus /gobi_0: Setting Powered False 12:31:09.449959 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 12:31:10.553916 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:10.565575 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:31:10.606095 tst ping.py: using LAC 40913 12:31:10.724857 tst ping.py: using RAC 113 12:31:10.839688 tst ping.py: using CellId 40913 12:31:10.954362 tst ping.py: using BVCI 40914 12:31:11.070560 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:11.082236 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:11.093790 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:11.105195 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:11.116541 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:11.127930 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:11.139319 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:11.150507 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:31:11.267878 tst ping.py:19: start network... 12:31:11.479977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:11.966697 run create_hlr_db(pid=22313): Launched 12:31:12.093598 bus /gobi_6: Setting Powered False 12:31:13.156485 run create_hlr_db(pid=22313): Terminated: ok {rc=0} 12:31:13.579651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22315): Launched 12:31:13.873589 run osmo-hlr_10.42.42.2(pid=22316): Launched 12:31:13.986282 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:14.508583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22318): Launched 12:31:14.803923 run osmo-stp_10.42.42.5(pid=22319): Launched 12:31:14.915520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:15.424450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22321): Launched 12:31:15.537249 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:15.786080 run patchelf(pid=22322): Launched 12:31:15.985750 run osmo-stp_10.42.42.5(pid=22319): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22319)] 12:31:16.125483 run osmo-stp_10.42.42.5(pid=22319): stdout: | (launched: 2022-12-14_12:31:14.748464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:16.266682 run osmo-stp_10.42.42.5(pid=22319): stderr: | [0;m[38;5;43m20221214123114920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123114920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123114921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123114921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123114921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123114922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123114922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:16.407068 run osmo-stp_10.42.42.5(pid=22319): stdout: | (launched: 2022-12-14_12:31:14.748464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:16.540905 run osmo-stp_10.42.42.5(pid=22319): stderr: | [0;m[38;5;43m20221214123114920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123114920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123114921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123114921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123114921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123114922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123114922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:16.700141 run patchelf(pid=22322): Terminating (SIGINT) 12:31:16.882479 run patchelf(pid=22322): Terminated: ok {rc=0} 12:31:17.013090 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22319): Process ended prematurely: osmo-stp_10.42.42.5(pid=22319) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22319)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 12:31:17.023359 tst ping.py:22: Test FAILED (6.5 sec) 12:31:17.052257 run osmo-hlr_10.42.42.2(pid=22316): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22316)] 12:31:17.114526 run osmo-hlr_10.42.42.2(pid=22316): stdout: | (launched: 2022-12-14_12:31:13.818469) 12:31:17.169570 run osmo-hlr_10.42.42.2(pid=22316): stderr: | [0;m[1;31m20221214123113995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123113995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123113996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123113996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123113996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123113996 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123114006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123114015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123114015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123114015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:17.221570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22315): Terminating (SIGTERM) 12:31:17.263280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22318): Terminating (SIGTERM) 12:31:17.305994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22321): Terminating (SIGTERM) 12:31:17.348483 --- ParallelTerminationStrategy: PID 22315 died... 12:31:17.368732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22315): Terminated: ok {rc=0} 12:31:17.414909 --- ParallelTerminationStrategy: PID 22318 died... 12:31:17.434835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22318): Terminated: ok {rc=0} 12:31:17.481238 --- ParallelTerminationStrategy: PID 22321 died... 12:31:17.501218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22321): Terminated: ok {rc=0} 12:31:17.589040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:31:18.676611 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:18.689088 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:31:18.730988 tst ping_idle_ping.py: using LAC 40914 12:31:18.847693 tst ping_idle_ping.py: using RAC 114 12:31:18.962513 tst ping_idle_ping.py: using CellId 40914 12:31:19.079075 tst ping_idle_ping.py: using BVCI 40915 12:31:19.187634 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:19.198715 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:19.209685 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:19.220298 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:19.231314 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:19.242339 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:19.253673 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:31:19.264669 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:31:19.383800 tst ping_idle_ping.py:24: start network... 12:31:19.596794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:20.094475 run create_hlr_db(pid=22323): Launched 12:31:20.223260 bus /gobi_6: Setting Powered False 12:31:21.286589 run create_hlr_db(pid=22323): Terminated: ok {rc=0} 12:31:21.714707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22325): Launched 12:31:22.011096 run osmo-hlr_10.42.42.2(pid=22326): Launched 12:31:22.123697 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:22.635670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22328): Launched 12:31:22.931343 run osmo-stp_10.42.42.5(pid=22329): Launched 12:31:23.043089 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:23.551740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22331): Launched 12:31:23.663787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:23.913782 run patchelf(pid=22332): Launched 12:31:24.078189 run osmo-stp_10.42.42.5(pid=22329): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22329)] 12:31:24.203946 run osmo-stp_10.42.42.5(pid=22329): stdout: | (launched: 2022-12-14_12:31:22.876482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:24.331555 run osmo-stp_10.42.42.5(pid=22329): stderr: | [0;m[38;5;43m20221214123123046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123123046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123123046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123123047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123123047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123123047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123123047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:24.458797 run osmo-stp_10.42.42.5(pid=22329): stdout: | (launched: 2022-12-14_12:31:22.876482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:24.579961 run osmo-stp_10.42.42.5(pid=22329): stderr: | [0;m[38;5;43m20221214123123046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123123046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123123046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123123047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123123047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123123047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123123047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:24.723166 run patchelf(pid=22332): Terminating (SIGINT) 12:31:24.889418 run patchelf(pid=22332): Terminated: ok {rc=0} 12:31:25.009147 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22329): Process ended prematurely: osmo-stp_10.42.42.5(pid=22329) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22329)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 12:31:25.017881 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 12:31:25.044302 run osmo-hlr_10.42.42.2(pid=22326): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22326)] 12:31:25.092082 run osmo-hlr_10.42.42.2(pid=22326): stdout: | (launched: 2022-12-14_12:31:21.956120) 12:31:25.140857 run osmo-hlr_10.42.42.2(pid=22326): stderr: | [0;m[1;31m20221214123122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123122130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123122143 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123122153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123122153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123122153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:25.190516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22325): Terminating (SIGTERM) 12:31:25.230439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22328): Terminating (SIGTERM) 12:31:25.270333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22331): Terminating (SIGTERM) 12:31:25.310496 --- ParallelTerminationStrategy: PID 22325 died... 12:31:25.329938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22325): Terminated: ok {rc=0} 12:31:25.374053 --- ParallelTerminationStrategy: PID 22328 died... 12:31:25.393012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22328): Terminated: ok {rc=0} 12:31:25.436433 --- ParallelTerminationStrategy: PID 22331 died... 12:31:25.455052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22331): Terminated: ok {rc=0} 12:31:25.540596 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:31:26.829588 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:31:26.836319 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:31:26.859635 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:31:26.897622 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:31:26.986796 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:31:27.012048 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:31:27.051180 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:31:27.642609 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:31:27.691879 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:27.703234 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:31:27.766794 tst cs_paging_gprs_active.py: using LAC 40915 12:31:27.883896 tst cs_paging_gprs_active.py: using RAC 115 12:31:27.999145 tst cs_paging_gprs_active.py: using CellId 40915 12:31:28.114427 tst cs_paging_gprs_active.py: using BVCI 40916 12:31:28.222662 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:28.233679 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:28.244494 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:28.255270 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:28.266416 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:28.277513 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:28.288631 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:28.299635 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:28.310966 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:28.426529 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:28.548440 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:31:28.765702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:29.090277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22336): Launched 12:31:29.372645 run iperf3-srv_10.42.42.10(pid=22337): Launched 12:31:29.493000 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:31:29.709582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:30.032275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22338): Launched 12:31:30.312329 run iperf3-srv_10.42.42.10(pid=22339): Launched 12:31:30.432831 tst cs_paging_gprs_active.py:38: start network... 12:31:30.648734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:31.164598 run create_hlr_db(pid=22340): Launched 12:31:31.323289 bus /gobi_6: Setting Powered False 12:31:32.386549 run create_hlr_db(pid=22340): Terminated: ok {rc=0} 12:31:32.847374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22342): Launched 12:31:33.148627 run osmo-hlr_10.42.42.2(pid=22343): Launched 12:31:33.262401 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:33.793700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22345): Launched 12:31:34.094409 run osmo-stp_10.42.42.5(pid=22346): Launched 12:31:34.208594 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:34.726021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22348): Launched 12:31:34.840229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:35.093992 run patchelf(pid=22349): Launched 12:31:35.260726 run osmo-stp_10.42.42.5(pid=22346): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22346)] 12:31:35.388140 run osmo-stp_10.42.42.5(pid=22346): stdout: | (launched: 2022-12-14_12:31:34.038247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:35.517460 run osmo-stp_10.42.42.5(pid=22346): stderr: | [0;m[38;5;43m20221214123134207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123134207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123134208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123134208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123134209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123134209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123134209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:35.647603 run osmo-stp_10.42.42.5(pid=22346): stdout: | (launched: 2022-12-14_12:31:34.038247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:35.770419 run osmo-stp_10.42.42.5(pid=22346): stderr: | [0;m[38;5;43m20221214123134207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123134207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123134208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123134208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123134209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123134209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123134209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:35.916344 run patchelf(pid=22349): Terminating (SIGINT) 12:31:36.085484 run patchelf(pid=22349): Terminated: ok {rc=0} 12:31:36.207470 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22346): Process ended prematurely: osmo-stp_10.42.42.5(pid=22346) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22346)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:31:36.216768 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:31:36.243800 run osmo-hlr_10.42.42.2(pid=22343): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22343)] 12:31:36.291248 run osmo-hlr_10.42.42.2(pid=22343): stdout: | (launched: 2022-12-14_12:31:33.092175) 12:31:36.340059 run osmo-hlr_10.42.42.2(pid=22343): stderr: | [0;m[1;31m20221214123133268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123133268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123133268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123133268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123133268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123133268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123133280 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123133289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123133289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123133289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:36.389565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22336): Terminating (SIGTERM) 12:31:36.429671 run iperf3-srv_10.42.42.10(pid=22337): Terminating (SIGTERM) 12:31:36.469653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22338): Terminating (SIGTERM) 12:31:36.509556 run iperf3-srv_10.42.42.10(pid=22339): Terminating (SIGTERM) 12:31:36.549502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22342): Terminating (SIGTERM) 12:31:36.589511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22345): Terminating (SIGTERM) 12:31:36.629400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22348): Terminating (SIGTERM) 12:31:36.669619 --- ParallelTerminationStrategy: PID 22336 died... 12:31:36.688983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22336): Terminated: ok {rc=0} 12:31:36.732712 --- ParallelTerminationStrategy: PID 22337 died... 12:31:36.751703 run iperf3-srv_10.42.42.10(pid=22337): Terminated {rc=256} 12:31:36.795319 --- ParallelTerminationStrategy: PID 22338 died... 12:31:36.814357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22338): Terminated: ok {rc=0} 12:31:36.857960 --- ParallelTerminationStrategy: PID 22339 died... 12:31:36.876755 run iperf3-srv_10.42.42.10(pid=22339): Terminated {rc=256} 12:31:36.920346 --- ParallelTerminationStrategy: PID 22342 died... 12:31:36.939235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22342): Terminated: ok {rc=0} 12:31:36.982524 --- ParallelTerminationStrategy: PID 22345 died... 12:31:37.001326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22345): Terminated: ok {rc=0} 12:31:37.044861 --- ParallelTerminationStrategy: PID 22348 died... 12:31:37.064159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22348): Terminated: ok {rc=0} 12:31:37.147615 bus /gobi_0: Setting Powered False 12:31:38.245378 bus /gobi_0: Setting Powered False 12:31:39.363546 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:31:40.508259 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:40.519892 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:31:40.581438 tst iperf3.py: using LAC 40916 12:31:40.701481 tst iperf3.py: using RAC 116 12:31:40.828562 tst iperf3.py: using CellId 40916 12:31:40.954399 tst iperf3.py: using BVCI 40917 12:31:41.072809 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:41.084335 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:41.095614 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:41.106891 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:41.118207 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:41.129541 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:41.140815 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:41.151942 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:41.163367 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:41.278579 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:31:41.480467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:41.783661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22350): Launched 12:31:42.046180 run iperf3-srv_10.42.42.10(pid=22351): Launched 12:31:42.158467 tst iperf3.py:8: start network... 12:31:42.358437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:42.822049 run create_hlr_db(pid=22352): Launched 12:31:42.937087 bus /gobi_6: Setting Powered False 12:31:43.996902 run create_hlr_db(pid=22352): Terminated: ok {rc=0} 12:31:44.438492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22354): Launched 12:31:44.761991 run osmo-hlr_10.42.42.2(pid=22355): Launched 12:31:44.883249 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:45.442639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22357): Launched 12:31:45.764726 run osmo-stp_10.42.42.5(pid=22358): Launched 12:31:45.911018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:46.585189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22360): Launched 12:31:46.728655 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:47.051956 run patchelf(pid=22361): Launched 12:31:47.268832 run osmo-stp_10.42.42.5(pid=22358): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22358)] 12:31:47.401864 run osmo-stp_10.42.42.5(pid=22358): stdout: | (launched: 2022-12-14_12:31:45.705064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:47.533430 run osmo-stp_10.42.42.5(pid=22358): stderr: | [0;m[38;5;43m20221214123146017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123146017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123146017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123146018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123146018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123146018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123146018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:47.662553 run osmo-stp_10.42.42.5(pid=22358): stdout: | (launched: 2022-12-14_12:31:45.705064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:47.785519 run osmo-stp_10.42.42.5(pid=22358): stderr: | [0;m[38;5;43m20221214123146017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123146017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123146017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123146018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123146018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123146018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123146018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:47.931304 run patchelf(pid=22361): Terminating (SIGINT) 12:31:48.100475 run patchelf(pid=22361): Terminated: ok {rc=0} 12:31:48.222748 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22358): Process ended prematurely: osmo-stp_10.42.42.5(pid=22358) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22358)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 12:31:48.232289 tst iperf3.py:8: Test FAILED (7.8 sec) 12:31:48.259417 run osmo-hlr_10.42.42.2(pid=22355): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22355)] 12:31:48.307565 run osmo-hlr_10.42.42.2(pid=22355): stdout: | (launched: 2022-12-14_12:31:44.702677) 12:31:48.357083 run osmo-hlr_10.42.42.2(pid=22355): stderr: | [0;m[1;31m20221214123144903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123144903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123144903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123144903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123144903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123144903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123144916 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123144925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123144926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123144926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:48.406804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22350): Terminating (SIGTERM) 12:31:48.446913 run iperf3-srv_10.42.42.10(pid=22351): Terminating (SIGTERM) 12:31:48.486768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22354): Terminating (SIGTERM) 12:31:48.527285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22357): Terminating (SIGTERM) 12:31:48.567712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22360): Terminating (SIGTERM) 12:31:48.608607 --- ParallelTerminationStrategy: PID 22350 died... 12:31:48.628448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22350): Terminated: ok {rc=0} 12:31:48.672538 --- ParallelTerminationStrategy: PID 22351 died... 12:31:48.691863 run iperf3-srv_10.42.42.10(pid=22351): Terminated {rc=256} 12:31:48.735894 --- ParallelTerminationStrategy: PID 22354 died... 12:31:48.754887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22354): Terminated: ok {rc=0} 12:31:48.798548 --- ParallelTerminationStrategy: PID 22357 died... 12:31:48.817558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22357): Terminated: ok {rc=0} 12:31:48.861561 --- ParallelTerminationStrategy: PID 22360 died... 12:31:48.880360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22360): Terminated: ok {rc=0} 12:31:48.964378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:31:50.113102 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:50.125378 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:31:50.187479 tst iperf3m4.py: using LAC 40917 12:31:50.312851 tst iperf3m4.py: using RAC 117 12:31:50.438966 tst iperf3m4.py: using CellId 40917 12:31:50.566199 tst iperf3m4.py: using BVCI 40918 12:31:50.684317 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:50.695970 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:50.707287 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:50.718588 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:50.729884 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:50.741226 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:50.752690 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:50.763988 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:50.775491 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:50.896214 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:51.015525 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:51.136844 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:51.256031 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:31:51.457716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:51.759849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22362): Launched 12:31:52.023219 run iperf3-srv_10.42.42.10(pid=22363): Launched 12:31:52.136936 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:31:52.337535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:52.639982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22364): Launched 12:31:52.903014 run iperf3-srv_10.42.42.10(pid=22365): Launched 12:31:53.014970 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:31:53.214688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:53.516528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22366): Launched 12:31:53.779559 run iperf3-srv_10.42.42.10(pid=22367): Launched 12:31:53.891994 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:31:54.092194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:54.394534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22368): Launched 12:31:54.656393 run iperf3-srv_10.42.42.10(pid=22369): Launched 12:31:54.768493 tst iperf3m4.py:8: start network... 12:31:54.967789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:55.431626 run create_hlr_db(pid=22370): Launched 12:31:55.546062 bus /gobi_6: Setting Powered False 12:31:56.606438 run create_hlr_db(pid=22370): Terminated: ok {rc=0} 12:31:57.047020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22372): Launched 12:31:57.370595 run osmo-hlr_10.42.42.2(pid=22373): Launched 12:31:57.495484 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:58.055571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22375): Launched 12:31:58.376915 run osmo-stp_10.42.42.5(pid=22376): Launched 12:31:58.498377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:59.053400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22378): Launched 12:31:59.177803 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:59.450861 run patchelf(pid=22379): Launched 12:31:59.629379 run osmo-stp_10.42.42.5(pid=22376): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22376)] 12:31:59.765270 run osmo-stp_10.42.42.5(pid=22376): stdout: | (launched: 2022-12-14_12:31:58.316870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:59.902894 run osmo-stp_10.42.42.5(pid=22376): stderr: | [0;m[38;5;43m20221214123158508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123158508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123158508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123158508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123158509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123158509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123158509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:00.039920 run osmo-stp_10.42.42.5(pid=22376): stdout: | (launched: 2022-12-14_12:31:58.316870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:00.171665 run osmo-stp_10.42.42.5(pid=22376): stderr: | [0;m[38;5;43m20221214123158508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123158508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123158508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123158508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123158509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123158509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123158509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:00.327466 run patchelf(pid=22379): Terminating (SIGINT) 12:32:00.508128 run patchelf(pid=22379): Terminated: ok {rc=0} 12:32:00.637900 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22376): Process ended prematurely: osmo-stp_10.42.42.5(pid=22376) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22376)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:32:00.648096 tst iperf3m4.py:8: Test FAILED (10.6 sec) 12:32:00.676832 run osmo-hlr_10.42.42.2(pid=22373): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22373)] 12:32:00.726273 run osmo-hlr_10.42.42.2(pid=22373): stdout: | (launched: 2022-12-14_12:31:57.310457) 12:32:00.777326 run osmo-hlr_10.42.42.2(pid=22373): stderr: | [0;m[1;31m20221214123157507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123157507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123157507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123157507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123157507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123157507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123157520 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123157530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123157530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123157530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:00.830023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22362): Terminating (SIGTERM) 12:32:00.898415 run iperf3-srv_10.42.42.10(pid=22363): Terminating (SIGTERM) 12:32:00.943938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22364): Terminating (SIGTERM) 12:32:00.987325 run iperf3-srv_10.42.42.10(pid=22365): Terminating (SIGTERM) 12:32:01.032878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22366): Terminating (SIGTERM) 12:32:01.075887 run iperf3-srv_10.42.42.10(pid=22367): Terminating (SIGTERM) 12:32:01.121364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22368): Terminating (SIGTERM) 12:32:01.164241 run iperf3-srv_10.42.42.10(pid=22369): Terminating (SIGTERM) 12:32:01.209392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22372): Terminating (SIGTERM) 12:32:01.252372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22375): Terminating (SIGTERM) 12:32:01.294822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22378): Terminating (SIGTERM) 12:32:01.337991 --- ParallelTerminationStrategy: PID 22362 died... 12:32:01.358481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22362): Terminated: ok {rc=0} 12:32:01.405610 --- ParallelTerminationStrategy: PID 22363 died... 12:32:01.425750 run iperf3-srv_10.42.42.10(pid=22363): Terminated {rc=256} 12:32:01.472027 --- ParallelTerminationStrategy: PID 22364 died... 12:32:01.492209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22364): Terminated: ok {rc=0} 12:32:01.538827 --- ParallelTerminationStrategy: PID 22365 died... 12:32:01.558939 run iperf3-srv_10.42.42.10(pid=22365): Terminated {rc=256} 12:32:01.605397 --- ParallelTerminationStrategy: PID 22366 died... 12:32:01.625853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22366): Terminated: ok {rc=0} 12:32:01.672640 --- ParallelTerminationStrategy: PID 22367 died... 12:32:01.692805 run iperf3-srv_10.42.42.10(pid=22367): Terminated {rc=256} 12:32:01.739577 --- ParallelTerminationStrategy: PID 22368 died... 12:32:01.759823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22368): Terminated: ok {rc=0} 12:32:01.807272 --- ParallelTerminationStrategy: PID 22369 died... 12:32:01.827523 run iperf3-srv_10.42.42.10(pid=22369): Terminated {rc=256} 12:32:01.874229 --- ParallelTerminationStrategy: PID 22372 died... 12:32:01.894775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22372): Terminated: ok {rc=0} 12:32:01.941352 --- ParallelTerminationStrategy: PID 22375 died... 12:32:01.961331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22375): Terminated: ok {rc=0} 12:32:02.007790 --- ParallelTerminationStrategy: PID 22378 died... 12:32:02.028064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22378): Terminated: ok {rc=0} 12:32:02.122151 bus /gobi_4: Setting Powered False 12:32:03.231195 bus /gobi_4: Setting Powered False 12:32:04.346613 bus /gobi_1: Setting Powered False 12:32:05.444744 bus /gobi_1: Setting Powered False 12:32:06.559183 bus /gobi_0: Setting Powered False 12:32:07.657332 bus /gobi_0: Setting Powered False 12:32:08.774491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:32:09.876439 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:09.888274 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:32:09.949622 tst ping.py: using LAC 40918 12:32:10.075652 tst ping.py: using RAC 118 12:32:10.198375 tst ping.py: using CellId 40918 12:32:10.320432 tst ping.py: using BVCI 40919 12:32:10.435906 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:10.447518 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:10.458785 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:10.470090 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:10.481408 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:10.492635 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:10.504022 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:10.515307 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:32:10.630086 tst ping.py:19: start network... 12:32:10.826569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:11.281306 run create_hlr_db(pid=22380): Launched 12:32:11.394178 bus /gobi_6: Setting Powered False 12:32:12.453088 run create_hlr_db(pid=22380): Terminated: ok {rc=0} 12:32:12.886402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22382): Launched 12:32:13.202639 run osmo-hlr_10.42.42.2(pid=22383): Launched 12:32:13.321997 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:13.873900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22385): Launched 12:32:14.169265 run osmo-stp_10.42.42.5(pid=22386): Launched 12:32:14.280472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:14.787680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22388): Launched 12:32:14.899774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:15.148291 run patchelf(pid=22389): Launched 12:32:15.311719 run osmo-stp_10.42.42.5(pid=22386): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22386)] 12:32:15.436933 run osmo-stp_10.42.42.5(pid=22386): stdout: | (launched: 2022-12-14_12:32:14.114427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:15.563309 run osmo-stp_10.42.42.5(pid=22386): stderr: | [0;m[38;5;43m20221214123214288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123214288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123214288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123214288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123214289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123214289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123214289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:15.689775 run osmo-stp_10.42.42.5(pid=22386): stdout: | (launched: 2022-12-14_12:32:14.114427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:15.810183 run osmo-stp_10.42.42.5(pid=22386): stderr: | [0;m[38;5;43m20221214123214288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123214288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123214288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123214288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123214289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123214289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123214289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:15.976655 run patchelf(pid=22389): Terminating (SIGINT) 12:32:16.145722 run patchelf(pid=22389): Terminated: ok {rc=0} 12:32:16.268506 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22386): Process ended prematurely: osmo-stp_10.42.42.5(pid=22386) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22386)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 12:32:16.278777 tst ping.py:22: Test FAILED (6.4 sec) 12:32:16.306603 run osmo-hlr_10.42.42.2(pid=22383): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22383)] 12:32:16.358247 run osmo-hlr_10.42.42.2(pid=22383): stdout: | (launched: 2022-12-14_12:32:13.144091) 12:32:16.408540 run osmo-hlr_10.42.42.2(pid=22383): stderr: | [0;m[1;31m20221214123213341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123213341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123213341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123213342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123213342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123213342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123213358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123213367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123213367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123213367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:16.460208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22382): Terminating (SIGTERM) 12:32:16.502329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22385): Terminating (SIGTERM) 12:32:16.545806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22388): Terminating (SIGTERM) 12:32:16.590024 --- ParallelTerminationStrategy: PID 22382 died... 12:32:16.611129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22382): Terminated: ok {rc=0} 12:32:16.658544 --- ParallelTerminationStrategy: PID 22385 died... 12:32:16.679255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22385): Terminated: ok {rc=0} 12:32:16.725237 --- ParallelTerminationStrategy: PID 22388 died... 12:32:16.745953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22388): Terminated: ok {rc=0} 12:32:16.832715 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:32:17.917641 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:17.929574 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:32:17.991173 tst ping_idle_ping.py: using LAC 40919 12:32:18.106535 tst ping_idle_ping.py: using RAC 119 12:32:18.223601 tst ping_idle_ping.py: using CellId 40919 12:32:18.338076 tst ping_idle_ping.py: using BVCI 40920 12:32:18.443817 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:18.455002 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:18.466119 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:18.476764 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:18.487751 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:18.498807 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:18.510063 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:32:18.521057 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:32:18.640462 tst ping_idle_ping.py:24: start network... 12:32:18.854042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:19.345819 run create_hlr_db(pid=22390): Launched 12:32:19.474508 bus /gobi_6: Setting Powered False 12:32:20.537251 run create_hlr_db(pid=22390): Terminated: ok {rc=0} 12:32:20.959698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22392): Launched 12:32:21.254962 run osmo-hlr_10.42.42.2(pid=22393): Launched 12:32:21.367160 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:21.872878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22395): Launched 12:32:22.167333 run osmo-stp_10.42.42.5(pid=22396): Launched 12:32:22.278752 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:22.786702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22398): Launched 12:32:22.898842 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:23.147693 run patchelf(pid=22399): Launched 12:32:23.311386 run osmo-stp_10.42.42.5(pid=22396): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22396)] 12:32:23.436502 run osmo-stp_10.42.42.5(pid=22396): stdout: | (launched: 2022-12-14_12:32:22.112215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:23.563718 run osmo-stp_10.42.42.5(pid=22396): stderr: | [0;m[38;5;43m20221214123222281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123222281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123222281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123222282 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123222284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123222284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123222284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:23.690481 run osmo-stp_10.42.42.5(pid=22396): stdout: | (launched: 2022-12-14_12:32:22.112215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:23.811217 run osmo-stp_10.42.42.5(pid=22396): stderr: | [0;m[38;5;43m20221214123222281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123222281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123222281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123222282 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123222284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123222284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123222284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:23.954375 run patchelf(pid=22399): Terminating (SIGINT) 12:32:24.120927 run patchelf(pid=22399): Terminated: ok {rc=0} 12:32:24.240228 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22396): Process ended prematurely: osmo-stp_10.42.42.5(pid=22396) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22396)] [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:32:24.249129 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 12:32:24.275540 run osmo-hlr_10.42.42.2(pid=22393): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22393)] 12:32:24.322836 run osmo-hlr_10.42.42.2(pid=22393): stdout: | (launched: 2022-12-14_12:32:21.200141) 12:32:24.371747 run osmo-hlr_10.42.42.2(pid=22393): stderr: | [0;m[1;31m20221214123221375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123221375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123221375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123221375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123221376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123221376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123221388 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123221398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123221399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123221399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:24.421093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22392): Terminating (SIGTERM) 12:32:24.460709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22395): Terminating (SIGTERM) 12:32:24.500382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22398): Terminating (SIGTERM) 12:32:24.540238 --- ParallelTerminationStrategy: PID 22392 died... 12:32:24.559718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22392): Terminated: ok {rc=0} 12:32:24.603580 --- ParallelTerminationStrategy: PID 22395 died... 12:32:24.622466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22395): Terminated: ok {rc=0} 12:32:24.665989 --- ParallelTerminationStrategy: PID 22398 died... 12:32:24.685000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22398): Terminated: ok {rc=0} 12:32:24.767374 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 12:32:26.066232 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:26.074755 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:32:26.099823 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:32:26.135524 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:32:26.191160 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:32:26.215909 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:32:26.250854 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:32:26.811953 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:32:26.817346 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:26.829296 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:32:26.897253 tst switch_tch_pdch.py: using LAC 40920 12:32:27.021092 tst switch_tch_pdch.py: using RAC 120 12:32:27.143655 tst switch_tch_pdch.py: using CellId 40920 12:32:27.265765 tst switch_tch_pdch.py: using BVCI 40921 12:32:27.380008 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:27.391985 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:27.404058 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:27.415938 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:27.427789 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:27.439619 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:27.451718 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:27.463582 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:32:27.581468 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:32:27.700688 tst switch_tch_pdch.py:51: start network... 12:32:27.913655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:28.405483 run create_hlr_db(pid=22404): Launched 12:32:28.533286 bus /gobi_6: Setting Powered False 12:32:29.596100 run create_hlr_db(pid=22404): Terminated: ok {rc=0} 12:32:30.019678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22406): Launched 12:32:30.315984 run osmo-hlr_10.42.42.2(pid=22407): Launched 12:32:30.427908 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:30.968516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22409): Launched 12:32:31.287401 run osmo-stp_10.42.42.5(pid=22410): Launched 12:32:31.431794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:32.068261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22412): Launched 12:32:32.187668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:32.449835 run patchelf(pid=22413): Launched 12:32:32.619355 run osmo-stp_10.42.42.5(pid=22410): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22410)] 12:32:32.744264 run osmo-stp_10.42.42.5(pid=22410): stdout: | (launched: 2022-12-14_12:32:31.230439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:32.871032 run osmo-stp_10.42.42.5(pid=22410): stderr: | [0;m[38;5;43m20221214123231562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123231562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123231562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123231563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123231563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123231563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123231563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:32.997845 run osmo-stp_10.42.42.5(pid=22410): stdout: | (launched: 2022-12-14_12:32:31.230439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:33.118427 run osmo-stp_10.42.42.5(pid=22410): stderr: | [0;m[38;5;43m20221214123231562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123231562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123231562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123231563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123231563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123231563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123231563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:33.261351 run patchelf(pid=22413): Terminating (SIGINT) 12:32:33.427067 run patchelf(pid=22413): Terminated: ok {rc=0} 12:32:33.546508 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22410): Process ended prematurely: osmo-stp_10.42.42.5(pid=22410) [trial-2404↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22410)] [trial-2404↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:32:33.555592 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:32:33.582104 run osmo-hlr_10.42.42.2(pid=22407): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22407)] 12:32:33.629774 run osmo-hlr_10.42.42.2(pid=22407): stdout: | (launched: 2022-12-14_12:32:30.260559) 12:32:33.678762 run osmo-hlr_10.42.42.2(pid=22407): stderr: | [0;m[1;31m20221214123230434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123230434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123230434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123230434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123230434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123230434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123230446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123230454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123230454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123230454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:33.728526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22406): Terminating (SIGTERM) 12:32:33.768453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22409): Terminating (SIGTERM) 12:32:33.808287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22412): Terminating (SIGTERM) 12:32:33.848401 --- ParallelTerminationStrategy: PID 22406 died... 12:32:33.867938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22406): Terminated: ok {rc=0} 12:32:33.911760 --- ParallelTerminationStrategy: PID 22409 died... 12:32:33.930705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22409): Terminated: ok {rc=0} 12:32:33.974331 --- ParallelTerminationStrategy: PID 22412 died... 12:32:33.993011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22412): Terminated: ok {rc=0} 12:32:34.078750 bus /gobi_0: Setting Powered False 12:32:35.176602 bus /gobi_0: Setting Powered False 12:32:36.291594 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 sms:nanobts+band-900 --------------------------------------------------------------------- 12:32:37.544738 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:37.549990 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:32:37.582690 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:32:37.610102 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 12:32:37.664509 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:32:37.698899 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:32:37.726002 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 12:32:38.267172 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 12:32:38.272339 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:38.283090 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 12:32:38.328695 tst mo_mt_sms.py: using LAC 40921 12:32:38.443476 tst mo_mt_sms.py: using RAC 121 12:32:38.560179 tst mo_mt_sms.py: using CellId 40921 12:32:38.677615 tst mo_mt_sms.py: using BVCI 40922 12:32:38.793280 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:38.804335 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:38.815384 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:38.826412 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:38.837383 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:38.848271 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 12:32:38.965165 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 12:32:39.079641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:39.532108 run create_hlr_db(pid=22417): Launched 12:32:39.644073 bus /gobi_6: Setting Powered False 12:32:40.702358 run create_hlr_db(pid=22417): Terminated: ok {rc=0} 12:32:41.113405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Launched 12:32:41.407633 run osmo-hlr_10.42.42.2(pid=22420): Launched 12:32:41.519209 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:42.040331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22422): Launched 12:32:42.334536 run osmo-stp_10.42.42.5(pid=22423): Launched 12:32:42.445818 run osmo-msc_10.42.42.6: Starting osmo-msc 12:32:42.976591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22425): Launched 12:32:43.271217 run osmo-msc_10.42.42.6(pid=22426): Launched 12:32:43.434868 run osmo-stp_10.42.42.5(pid=22423): ERR: Terminated: ERROR {rc=1} [trial-2404↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22423)] 12:32:43.559801 run osmo-stp_10.42.42.5(pid=22423): stdout: | (launched: 2022-12-14_12:32:42.279798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:43.684748 run osmo-stp_10.42.42.5(pid=22423): stderr: | [0;m[38;5;43m20221214123242448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123242448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123242448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123242449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123242449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123242450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123242450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:43.807262 run osmo-stp_10.42.42.5(pid=22423): stdout: | (launched: 2022-12-14_12:32:42.279798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:43.925285 run osmo-stp_10.42.42.5(pid=22423): stderr: | [0;m[38;5;43m20221214123242448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123242448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123242448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123242449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123242449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123242450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123242450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:44.065234 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22423): Process ended prematurely: osmo-stp_10.42.42.5(pid=22423) [trial-2404↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22423)] [trial-2404↪sms:nanobts+band-900↪mo_mt_sms.py:16] 12:32:44.073613 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 12:32:44.099252 run osmo-hlr_10.42.42.2(pid=22420): ERR: Terminated: ERROR {rc=237} [trial-2404↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22420)] 12:32:44.147334 run osmo-hlr_10.42.42.2(pid=22420): stdout: | (launched: 2022-12-14_12:32:41.352482) 12:32:44.196111 run osmo-hlr_10.42.42.2(pid=22420): stderr: | [0;m[1;31m20221214123241528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123241528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123241528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123241528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123241528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123241528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123241540 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123241548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123241548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123241548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:44.264498 run osmo-msc_10.42.42.6(pid=22426): ERR: Terminated: ERROR {rc=2} [trial-2404↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22426)] 12:32:44.311364 run osmo-msc_10.42.42.6(pid=22426): stdout: | (launched: 2022-12-14_12:32:43.215889) 12:32:44.359988 run osmo-msc_10.42.42.6(pid=22426): stderr: | [0;m[38;5;43m20221214123243486 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123243486 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe006eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123243487 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123243487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123243487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123243487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123243489 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123243489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123243489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123243489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:32:44.409296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Terminating (SIGTERM) 12:32:44.448717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22422): Terminating (SIGTERM) 12:32:44.488110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22425): Terminating (SIGTERM) 12:32:44.528031 --- ParallelTerminationStrategy: PID 22419 died... 12:32:44.547576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Terminated: ok {rc=0} 12:32:44.591494 --- ParallelTerminationStrategy: PID 22422 died... 12:32:44.610473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22422): Terminated: ok {rc=0} 12:32:44.654152 --- ParallelTerminationStrategy: PID 22425 died... 12:32:44.673037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22425): Terminated: ok {rc=0} 12:32:44.756547 bus /sierra_3: Setting Powered False 12:32:45.861592 bus /sierra_3: Setting Powered False 12:32:46.997014 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 12:32:48.224922 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:48.229492 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:32:48.260806 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 12:32:48.268702 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 12:32:48.304749 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:32:48.336803 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 12:32:48.343658 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 12:32:48.862465 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 12:32:48.867542 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 12:32:48.878478 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 12:32:48.925190 tst assert_extension.py: using LAC 40922 12:32:49.053496 tst assert_extension.py: using RAC 122 12:32:49.175691 tst assert_extension.py: using CellId 40922 12:32:49.291897 tst assert_extension.py: using BVCI 40923 12:32:49.407834 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 12:32:49.523001 tst assert_extension.py:10: start nitb and bts... 12:32:49.719583 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:32:50.321893 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22431): Launched 12:32:50.615657 run osmo-nitb_10.42.42.2(pid=22432): Launched 12:32:50.777889 run osmo-nitb_10.42.42.2(pid=22432): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22432)] 12:32:50.910773 run osmo-nitb_10.42.42.2(pid=22432): stdout: | (launched: 2022-12-14_12:32:50.560736) 12:32:51.045465 run osmo-nitb_10.42.42.2(pid=22432): stderr: | (launched: 2022-12-14_12:32:50.604205) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:51.179761 run osmo-nitb_10.42.42.2(pid=22432): stdout: | (launched: 2022-12-14_12:32:50.560736) 12:32:51.308703 run osmo-nitb_10.42.42.2(pid=22432): stderr: | (launched: 2022-12-14_12:32:50.604205) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22432): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22432) [trial-2404↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22432)] 12:32:51.726316 tst osmo-nitb_10.42.42.2(pid=22432): stdout: | (launched: 2022-12-14_12:32:50.560736) 12:32:51.846088 tst osmo-nitb_10.42.42.2(pid=22432): stderr: | (launched: 2022-12-14_12:32:50.604205) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:51.986567 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22432): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22432) [trial-2404↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22432)] [trial-2404↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 12:32:51.994910 tst assert_extension.py:12: Test FAILED (3.1 sec) 12:32:52.001371 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22431): Terminating (SIGTERM) 12:32:52.210527 --- ParallelTerminationStrategy: PID 22431 died... 12:32:52.231364 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22431): Terminated: ok {rc=0} 12:32:52.317420 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 ussd:nanobts+band-900 --------------------------------------------------------------------- 12:32:53.493690 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:53.498743 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:32:53.530755 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:32:53.558534 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 12:32:53.593685 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:32:53.625427 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:32:53.651567 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 12:32:54.181295 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 12:32:54.186395 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:54.197070 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 12:32:54.245808 tst assert_extension.py: using LAC 40923 12:32:54.361352 tst assert_extension.py: using RAC 123 12:32:54.476743 tst assert_extension.py: using CellId 40923 12:32:54.590482 tst assert_extension.py: using BVCI 40924 12:32:54.698424 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:54.709091 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:54.719617 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:54.730154 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:54.741044 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:32:54.751819 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 12:32:54.869943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:55.358483 run create_hlr_db(pid=22437): Launched 12:32:55.486226 bus /sierra_2: Setting Powered False 12:32:56.545592 run create_hlr_db(pid=22437): Terminated: ok {rc=0} 12:32:56.986279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22439): Launched 12:32:57.301955 run osmo-hlr_10.42.42.2(pid=22440): Launched 12:32:57.422168 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:57.969781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22442): Launched 12:32:58.285772 run osmo-stp_10.42.42.5(pid=22443): Launched 12:32:58.405517 run osmo-msc_10.42.42.6: Starting osmo-msc 12:32:58.974613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22445): Launched 12:32:59.288770 run osmo-msc_10.42.42.6(pid=22446): Launched 12:32:59.465412 run osmo-stp_10.42.42.5(pid=22443): ERR: Terminated: ERROR {rc=1} [trial-2404↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22443)] 12:32:59.598459 run osmo-stp_10.42.42.5(pid=22443): stdout: | (launched: 2022-12-14_12:32:58.226927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:59.731304 run osmo-stp_10.42.42.5(pid=22443): stderr: | [0;m[38;5;43m20221214123258421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123258421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123258421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123258422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123258422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123258422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123258422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:59.863626 run osmo-stp_10.42.42.5(pid=22443): stdout: | (launched: 2022-12-14_12:32:58.226927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:59.989055 run osmo-stp_10.42.42.5(pid=22443): stderr: | [0;m[38;5;43m20221214123258421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123258421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123258421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123258422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123258422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123258422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123258422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:00.138681 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22443): Process ended prematurely: osmo-stp_10.42.42.5(pid=22443) [trial-2404↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22443)] [trial-2404↪ussd:nanobts+band-900↪assert_extension.py:17] 12:33:00.147697 tst assert_extension.py:17: Test FAILED (6.0 sec) 12:33:00.174737 run osmo-hlr_10.42.42.2(pid=22440): ERR: Terminated: ERROR {rc=237} [trial-2404↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22440)] 12:33:00.224337 run osmo-hlr_10.42.42.2(pid=22440): stdout: | (launched: 2022-12-14_12:32:57.243427) 12:33:00.276199 run osmo-hlr_10.42.42.2(pid=22440): stderr: | [0;m[1;31m20221214123257440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123257441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123257441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123257441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123257441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123257441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123257453 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123257461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123257461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123257461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:00.347395 run osmo-msc_10.42.42.6(pid=22446): ERR: Terminated: ERROR {rc=2} [trial-2404↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22446)] 12:33:00.397302 run osmo-msc_10.42.42.6(pid=22446): stdout: | (launched: 2022-12-14_12:32:59.230513) 12:33:00.448419 run osmo-msc_10.42.42.6(pid=22446): stderr: | [0;m[38;5;43m20221214123259552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123259552 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8808a0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123259552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123259552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123259552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123259552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123259554 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123259554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123259555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123259555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:00.499572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22439): Terminating (SIGTERM) 12:33:00.540581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22442): Terminating (SIGTERM) 12:33:00.581772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22445): Terminating (SIGTERM) 12:33:00.623050 --- ParallelTerminationStrategy: PID 22439 died... 12:33:00.642830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22439): Terminated: ok {rc=0} 12:33:00.688506 --- ParallelTerminationStrategy: PID 22442 died... 12:33:00.707855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22442): Terminated: ok {rc=0} 12:33:00.753337 --- ParallelTerminationStrategy: PID 22445 died... 12:33:00.772699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22445): Terminated: ok {rc=0} 12:33:00.876035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:33:02.096447 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:02.104372 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:33:02.148503 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:33:02.182288 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:33:02.239673 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:33:02.273597 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:33:02.305874 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:33:02.850943 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:33:02.904920 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:02.916550 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:33:02.984604 tst mo_mt_call.py: using LAC 40924 12:33:03.116178 tst mo_mt_call.py: using RAC 124 12:33:03.240413 tst mo_mt_call.py: using CellId 40924 12:33:03.369087 tst mo_mt_call.py: using BVCI 40925 12:33:03.478401 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:03.489829 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:03.500912 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:03.512061 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:03.523763 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:03.535349 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:33:03.654868 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:33:03.774756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:04.271443 run create_hlr_db(pid=22452): Launched 12:33:04.401523 bus /sierra_2: Setting Powered False 12:33:05.466285 run create_hlr_db(pid=22452): Terminated: ok {rc=0} 12:33:05.895385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22454): Launched 12:33:06.194391 run osmo-hlr_10.42.42.2(pid=22455): Launched 12:33:06.307451 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:06.831682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22457): Launched 12:33:07.130772 run osmo-stp_10.42.42.5(pid=22458): Launched 12:33:07.244658 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:07.786464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22460): Launched 12:33:08.086456 run osmo-msc_10.42.42.6(pid=22461): Launched 12:33:08.254003 run osmo-stp_10.42.42.5(pid=22458): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22458)] 12:33:08.381557 run osmo-stp_10.42.42.5(pid=22458): stdout: | (launched: 2022-12-14_12:33:07.074855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:08.508570 run osmo-stp_10.42.42.5(pid=22458): stderr: | [0;m[38;5;43m20221214123307246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123307246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123307247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123307247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123307247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123307248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123307248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:08.633515 run osmo-stp_10.42.42.5(pid=22458): stdout: | (launched: 2022-12-14_12:33:07.074855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:08.752514 run osmo-stp_10.42.42.5(pid=22458): stderr: | [0;m[38;5;43m20221214123307246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123307246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123307247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123307247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123307247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123307248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123307248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:08.894900 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22458): Process ended prematurely: osmo-stp_10.42.42.5(pid=22458) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22458)] [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:33:08.903635 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:33:08.929826 run osmo-hlr_10.42.42.2(pid=22455): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22455)] 12:33:08.977520 run osmo-hlr_10.42.42.2(pid=22455): stdout: | (launched: 2022-12-14_12:33:06.138910) 12:33:09.026453 run osmo-hlr_10.42.42.2(pid=22455): stderr: | [0;m[1;31m20221214123306317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123306317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123306317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123306317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123306317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123306317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123306334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123306343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123306344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123306344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:09.095341 run osmo-msc_10.42.42.6(pid=22461): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22461)] 12:33:09.142413 run osmo-msc_10.42.42.6(pid=22461): stdout: | (launched: 2022-12-14_12:33:08.030743) 12:33:09.191211 run osmo-msc_10.42.42.6(pid=22461): stderr: | [0;m[38;5;43m20221214123308301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123308302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fde54264c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123308302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123308302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123308302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123308302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123308304 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123308304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123308304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123308304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:09.240306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22454): Terminating (SIGTERM) 12:33:09.279718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22457): Terminating (SIGTERM) 12:33:09.319189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22460): Terminating (SIGTERM) 12:33:09.359255 --- ParallelTerminationStrategy: PID 22454 died... 12:33:09.378627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22454): Terminated: ok {rc=0} 12:33:09.422336 --- ParallelTerminationStrategy: PID 22457 died... 12:33:09.440822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22457): Terminated: ok {rc=0} 12:33:09.484618 --- ParallelTerminationStrategy: PID 22460 died... 12:33:09.503445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22460): Terminated: ok {rc=0} 12:33:09.588572 bus /sierra_3: Setting Powered False 12:33:10.686556 bus /sierra_3: Setting Powered False 12:33:11.799689 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:33:12.943372 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:12.955301 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:33:13.022625 tst mo_mt_call_osmux.py: using LAC 40925 12:33:13.139354 tst mo_mt_call_osmux.py: using RAC 125 12:33:13.257635 tst mo_mt_call_osmux.py: using CellId 40925 12:33:13.387468 tst mo_mt_call_osmux.py: using BVCI 40926 12:33:13.498091 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:13.509503 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:13.520496 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:13.531733 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:13.543238 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:33:13.554727 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:33:13.676137 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:33:13.794149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:14.258722 run create_hlr_db(pid=22463): Launched 12:33:14.373465 bus /sierra_2: Setting Powered False 12:33:15.433967 run create_hlr_db(pid=22463): Terminated: ok {rc=0} 12:33:15.853737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22465): Launched 12:33:16.204842 run osmo-hlr_10.42.42.2(pid=22466): Launched 12:33:16.455509 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:17.131445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22468): Launched 12:33:17.458462 run osmo-stp_10.42.42.5(pid=22469): Launched 12:33:17.582981 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:18.167416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22471): Launched 12:33:18.491212 run osmo-msc_10.42.42.6(pid=22472): Launched 12:33:18.670515 run osmo-stp_10.42.42.5(pid=22469): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22469)] 12:33:18.806451 run osmo-stp_10.42.42.5(pid=22469): stdout: | (launched: 2022-12-14_12:33:17.398570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:18.943422 run osmo-stp_10.42.42.5(pid=22469): stderr: | [0;m[38;5;43m20221214123317594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123317594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123317594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123317595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123317595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123317595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123317595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:19.078347 run osmo-stp_10.42.42.5(pid=22469): stdout: | (launched: 2022-12-14_12:33:17.398570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:19.205881 run osmo-stp_10.42.42.5(pid=22469): stderr: | [0;m[38;5;43m20221214123317594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123317594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123317594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123317595 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123317595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123317595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123317595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:19.358646 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22469): Process ended prematurely: osmo-stp_10.42.42.5(pid=22469) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22469)] [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:33:19.368372 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:33:19.396466 run osmo-hlr_10.42.42.2(pid=22466): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22466)] 12:33:19.446333 run osmo-hlr_10.42.42.2(pid=22466): stdout: | (launched: 2022-12-14_12:33:16.143058) 12:33:19.497774 run osmo-hlr_10.42.42.2(pid=22466): stderr: | [0;m[1;31m20221214123316450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123316450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123316450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123316450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123316450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123316450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123316474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123316482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123316482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123316482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:19.569767 run osmo-msc_10.42.42.6(pid=22472): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22472)] 12:33:19.619165 run osmo-msc_10.42.42.6(pid=22472): stdout: | (launched: 2022-12-14_12:33:18.431050) 12:33:19.670139 run osmo-msc_10.42.42.6(pid=22472): stderr: | [0;m[38;5;43m20221214123318753 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123318753 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1080b0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123318753 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123318753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123318753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123318753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123318755 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123318755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123318755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123318755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:19.721639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22465): Terminating (SIGTERM) 12:33:19.763408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22468): Terminating (SIGTERM) 12:33:19.805157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22471): Terminating (SIGTERM) 12:33:19.846917 --- ParallelTerminationStrategy: PID 22465 died... 12:33:19.867031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22465): Terminated: ok {rc=0} 12:33:19.912721 --- ParallelTerminationStrategy: PID 22468 died... 12:33:19.932151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22468): Terminated: ok {rc=0} 12:33:19.977761 --- ParallelTerminationStrategy: PID 22471 died... 12:33:19.997335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22471): Terminated: ok {rc=0} 12:33:20.084038 bus /sierra_3: Setting Powered False 12:33:21.180832 bus /sierra_3: Setting Powered False 12:33:22.298741 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:33:23.549859 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:23.557024 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:33:23.588780 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:33:23.615716 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:33:23.669121 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:33:23.701863 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:33:23.728938 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:33:24.276657 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:33:24.325247 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:24.336213 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:33:24.401962 tst mo_mt_call.py: using LAC 40926 12:33:24.519631 tst mo_mt_call.py: using RAC 126 12:33:24.638565 tst mo_mt_call.py: using CellId 40926 12:33:24.758518 tst mo_mt_call.py: using BVCI 40927 12:33:24.868612 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:24.879725 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:24.890667 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:24.901686 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:24.912837 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:24.924055 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:33:25.041478 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:33:25.162214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:25.627395 run create_hlr_db(pid=22477): Launched 12:33:25.740846 bus /sierra_2: Setting Powered False 12:33:26.801577 run create_hlr_db(pid=22477): Terminated: ok {rc=0} 12:33:27.221632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22479): Launched 12:33:27.523286 run osmo-hlr_10.42.42.2(pid=22480): Launched 12:33:27.636614 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:28.170504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22482): Launched 12:33:28.472225 run osmo-stp_10.42.42.5(pid=22483): Launched 12:33:28.586651 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:29.129029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22485): Launched 12:33:29.429665 run osmo-msc_10.42.42.6(pid=22486): Launched 12:33:29.597830 run osmo-stp_10.42.42.5(pid=22483): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22483)] 12:33:29.726401 run osmo-stp_10.42.42.5(pid=22483): stdout: | (launched: 2022-12-14_12:33:28.416064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:29.854423 run osmo-stp_10.42.42.5(pid=22483): stderr: | [0;m[38;5;43m20221214123328589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123328589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123328589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123328590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123328590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123328590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123328590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:29.979979 run osmo-stp_10.42.42.5(pid=22483): stdout: | (launched: 2022-12-14_12:33:28.416064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:30.099719 run osmo-stp_10.42.42.5(pid=22483): stderr: | [0;m[38;5;43m20221214123328589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123328589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123328589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123328590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123328590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123328590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123328590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:30.242970 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22483): Process ended prematurely: osmo-stp_10.42.42.5(pid=22483) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22483)] [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:33:30.251996 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:33:30.278239 run osmo-hlr_10.42.42.2(pid=22480): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22480)] 12:33:30.326272 run osmo-hlr_10.42.42.2(pid=22480): stdout: | (launched: 2022-12-14_12:33:27.466436) 12:33:30.375183 run osmo-hlr_10.42.42.2(pid=22480): stderr: | [0;m[1;31m20221214123327642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123327642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123327642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123327642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123327642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123327642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123327654 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123327664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123327665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123327665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:30.444080 run osmo-msc_10.42.42.6(pid=22486): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22486)] 12:33:30.491293 run osmo-msc_10.42.42.6(pid=22486): stdout: | (launched: 2022-12-14_12:33:29.373297) 12:33:30.540064 run osmo-msc_10.42.42.6(pid=22486): stderr: | [0;m[38;5;43m20221214123329642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123329642 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f88828eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123329642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123329643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123329643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123329643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123329645 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123329645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123329645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123329645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:30.589144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22479): Terminating (SIGTERM) 12:33:30.628692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22482): Terminating (SIGTERM) 12:33:30.668242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22485): Terminating (SIGTERM) 12:33:30.708102 --- ParallelTerminationStrategy: PID 22479 died... 12:33:30.727592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22479): Terminated: ok {rc=0} 12:33:30.771313 --- ParallelTerminationStrategy: PID 22482 died... 12:33:30.790082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22482): Terminated: ok {rc=0} 12:33:30.848391 --- ParallelTerminationStrategy: PID 22485 died... 12:33:30.874998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22485): Terminated: ok {rc=0} 12:33:30.962043 bus /sierra_3: Setting Powered False 12:33:32.064695 bus /sierra_3: Setting Powered False 12:33:33.178381 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:33:34.326955 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:34.339304 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:33:34.407763 tst mo_mt_call_osmux.py: using LAC 40927 12:33:34.533632 tst mo_mt_call_osmux.py: using RAC 127 12:33:34.659661 tst mo_mt_call_osmux.py: using CellId 40927 12:33:34.785612 tst mo_mt_call_osmux.py: using BVCI 40928 12:33:34.897773 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:34.908849 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:34.920052 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:34.930977 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:34.942927 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:33:34.954822 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:33:35.077270 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:33:35.197497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:35.696874 run create_hlr_db(pid=22488): Launched 12:33:35.826825 bus /sierra_2: Setting Powered False 12:33:36.890347 run create_hlr_db(pid=22488): Terminated: ok {rc=0} 12:33:37.323024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22491): Launched 12:33:37.624759 run osmo-hlr_10.42.42.2(pid=22492): Launched 12:33:37.739955 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:38.273604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22494): Launched 12:33:38.573893 run osmo-stp_10.42.42.5(pid=22495): Launched 12:33:38.688249 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:39.230721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22497): Launched 12:33:39.531173 run osmo-msc_10.42.42.6(pid=22498): Launched 12:33:39.698910 run osmo-stp_10.42.42.5(pid=22495): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22495)] 12:33:39.826951 run osmo-stp_10.42.42.5(pid=22495): stdout: | (launched: 2022-12-14_12:33:38.517786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:39.957443 run osmo-stp_10.42.42.5(pid=22495): stderr: | [0;m[38;5;43m20221214123338688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123338689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123338689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123338690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123338691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123338691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123338691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:40.091103 run osmo-stp_10.42.42.5(pid=22495): stdout: | (launched: 2022-12-14_12:33:38.517786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:40.218488 run osmo-stp_10.42.42.5(pid=22495): stderr: | [0;m[38;5;43m20221214123338688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123338689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123338689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123338690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123338691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123338691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123338691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:40.370952 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22495): Process ended prematurely: osmo-stp_10.42.42.5(pid=22495) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22495)] [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:33:40.380450 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:33:40.408345 run osmo-hlr_10.42.42.2(pid=22492): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22492)] 12:33:40.458138 run osmo-hlr_10.42.42.2(pid=22492): stdout: | (launched: 2022-12-14_12:33:37.568395) 12:33:40.509414 run osmo-hlr_10.42.42.2(pid=22492): stderr: | [0;m[1;31m20221214123337745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123337746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123337746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123337746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123337746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123337746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123337758 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123337767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123337767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123337767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:40.581431 run osmo-msc_10.42.42.6(pid=22498): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22498)] 12:33:40.631089 run osmo-msc_10.42.42.6(pid=22498): stdout: | (launched: 2022-12-14_12:33:39.474880) 12:33:40.682026 run osmo-msc_10.42.42.6(pid=22498): stderr: | [0;m[38;5;43m20221214123339745 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123339745 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb7e265bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123339745 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123339745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123339746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123339746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123339748 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123339748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123339748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123339748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:40.733443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22491): Terminating (SIGTERM) 12:33:40.775017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22494): Terminating (SIGTERM) 12:33:40.817722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22497): Terminating (SIGTERM) 12:33:40.859606 --- ParallelTerminationStrategy: PID 22491 died... 12:33:40.879443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22491): Terminated: ok {rc=0} 12:33:40.925083 --- ParallelTerminationStrategy: PID 22494 died... 12:33:40.944505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22494): Terminated: ok {rc=0} 12:33:40.989893 --- ParallelTerminationStrategy: PID 22497 died... 12:33:41.009330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22497): Terminated: ok {rc=0} 12:33:41.096839 bus /sierra_3: Setting Powered False 12:33:42.193126 bus /sierra_3: Setting Powered False 12:33:43.308549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:33:44.555604 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:44.563104 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:33:44.595622 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:33:44.623468 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:33:44.674760 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:33:44.706732 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:33:44.733705 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:33:45.284562 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:33:45.332920 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:45.344605 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:33:45.410968 tst mo_mt_call.py: using LAC 40928 12:33:45.529242 tst mo_mt_call.py: using RAC 128 12:33:45.655717 tst mo_mt_call.py: using CellId 40928 12:33:45.780712 tst mo_mt_call.py: using BVCI 40929 12:33:45.903242 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:45.915559 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:45.932838 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:45.945644 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:45.957908 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:45.969790 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:33:46.095617 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:33:46.234433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:46.762006 run create_hlr_db(pid=22503): Launched 12:33:46.924093 bus /sierra_2: Setting Powered False 12:33:47.988371 run create_hlr_db(pid=22503): Terminated: ok {rc=0} 12:33:48.427904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22505): Launched 12:33:48.727985 run osmo-hlr_10.42.42.2(pid=22506): Launched 12:33:48.841468 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:49.368198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22508): Launched 12:33:49.668471 run osmo-stp_10.42.42.5(pid=22509): Launched 12:33:49.782408 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:50.324739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22511): Launched 12:33:50.625147 run osmo-msc_10.42.42.6(pid=22512): Launched 12:33:50.793497 run osmo-stp_10.42.42.5(pid=22509): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22509)] 12:33:50.921481 run osmo-stp_10.42.42.5(pid=22509): stdout: | (launched: 2022-12-14_12:33:49.612608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:51.049457 run osmo-stp_10.42.42.5(pid=22509): stderr: | [0;m[38;5;43m20221214123349782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123349782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123349782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123349783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123349783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123349783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123349783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:51.174949 run osmo-stp_10.42.42.5(pid=22509): stdout: | (launched: 2022-12-14_12:33:49.612608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:51.294290 run osmo-stp_10.42.42.5(pid=22509): stderr: | [0;m[38;5;43m20221214123349782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123349782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123349782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123349783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123349783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123349783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123349783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:51.437222 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22509): Process ended prematurely: osmo-stp_10.42.42.5(pid=22509) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22509)] [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:33:51.446179 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:33:51.472752 run osmo-hlr_10.42.42.2(pid=22506): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22506)] 12:33:51.520746 run osmo-hlr_10.42.42.2(pid=22506): stdout: | (launched: 2022-12-14_12:33:48.672011) 12:33:51.569866 run osmo-hlr_10.42.42.2(pid=22506): stderr: | [0;m[1;31m20221214123348849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123348849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123348849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123348849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123348849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123348849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123348866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123348875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123348876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123348876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:51.638806 run osmo-msc_10.42.42.6(pid=22512): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22512)] 12:33:51.685839 run osmo-msc_10.42.42.6(pid=22512): stdout: | (launched: 2022-12-14_12:33:50.569197) 12:33:51.734794 run osmo-msc_10.42.42.6(pid=22512): stderr: | [0;m[38;5;43m20221214123350842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123350842 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9dd826bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123350842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123350842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123350842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123350842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123350844 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123350845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123350845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123350845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:51.784216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22505): Terminating (SIGTERM) 12:33:51.824460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22508): Terminating (SIGTERM) 12:33:51.864252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22511): Terminating (SIGTERM) 12:33:51.904809 --- ParallelTerminationStrategy: PID 22505 died... 12:33:51.924490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22505): Terminated: ok {rc=0} 12:33:51.968592 --- ParallelTerminationStrategy: PID 22508 died... 12:33:51.987639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22508): Terminated: ok {rc=0} 12:33:52.031517 --- ParallelTerminationStrategy: PID 22511 died... 12:33:52.050486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22511): Terminated: ok {rc=0} 12:33:52.136169 bus /sierra_3: Setting Powered False 12:33:53.234426 bus /sierra_3: Setting Powered False 12:33:54.347383 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:33:55.495384 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:55.508127 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:33:55.577413 tst mo_mt_call_osmux.py: using LAC 40929 12:33:55.705409 tst mo_mt_call_osmux.py: using RAC 129 12:33:55.825388 tst mo_mt_call_osmux.py: using CellId 40929 12:33:55.952337 tst mo_mt_call_osmux.py: using BVCI 40930 12:33:56.070037 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:56.081795 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:56.093355 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:56.104853 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:56.116431 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:33:56.128079 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:33:56.244730 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:33:56.370570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:56.872721 run create_hlr_db(pid=22514): Launched 12:33:57.002299 bus /sierra_2: Setting Powered False 12:33:58.066258 run create_hlr_db(pid=22514): Terminated: ok {rc=0} 12:33:58.516689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22516): Launched 12:33:58.840264 run osmo-hlr_10.42.42.2(pid=22517): Launched 12:33:58.962660 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:59.516735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22519): Launched 12:33:59.837954 run osmo-stp_10.42.42.5(pid=22520): Launched 12:33:59.959711 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:00.542142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22522): Launched 12:34:00.870092 run osmo-msc_10.42.42.6(pid=22523): Launched 12:34:01.266520 run osmo-stp_10.42.42.5(pid=22520): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22520)] 12:34:01.519199 run osmo-stp_10.42.42.5(pid=22520): stdout: | (launched: 2022-12-14_12:33:59.778437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:01.657310 run osmo-stp_10.42.42.5(pid=22520): stderr: | [0;m[38;5;43m20221214123359971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123359972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123359972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123359972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123359973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123359973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123359973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:01.794754 run osmo-stp_10.42.42.5(pid=22520): stdout: | (launched: 2022-12-14_12:33:59.778437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:01.925276 run osmo-stp_10.42.42.5(pid=22520): stderr: | [0;m[38;5;43m20221214123359971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123359972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123359972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123359972 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123359973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123359973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123359973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:02.081008 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22520): Process ended prematurely: osmo-stp_10.42.42.5(pid=22520) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22520)] [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:34:02.091847 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:34:02.120872 run osmo-hlr_10.42.42.2(pid=22517): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22517)] 12:34:02.171286 run osmo-hlr_10.42.42.2(pid=22517): stdout: | (launched: 2022-12-14_12:33:58.780673) 12:34:02.223716 run osmo-hlr_10.42.42.2(pid=22517): stderr: | [0;m[1;31m20221214123358979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123358979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123358979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123358979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123358979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123358979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123358992 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123359000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123359000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123359000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:02.296534 run osmo-msc_10.42.42.6(pid=22523): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22523)] 12:34:02.346643 run osmo-msc_10.42.42.6(pid=22523): stdout: | (launched: 2022-12-14_12:34:00.804890) 12:34:02.397599 run osmo-msc_10.42.42.6(pid=22523): stderr: | [0;m[38;5;43m20221214123401266 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123401266 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fee05dbac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123401266 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123401266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123401270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123401271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123401272 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123401278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123401279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123401279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:02.449104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22516): Terminating (SIGTERM) 12:34:02.490693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22519): Terminating (SIGTERM) 12:34:02.532531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22522): Terminating (SIGTERM) 12:34:02.574411 --- ParallelTerminationStrategy: PID 22516 died... 12:34:02.594379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22516): Terminated: ok {rc=0} 12:34:02.640017 --- ParallelTerminationStrategy: PID 22519 died... 12:34:02.659468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22519): Terminated: ok {rc=0} 12:34:02.704907 --- ParallelTerminationStrategy: PID 22522 died... 12:34:02.724369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22522): Terminated: ok {rc=0} 12:34:02.811608 bus /sierra_3: Setting Powered False 12:34:03.909144 bus /sierra_3: Setting Powered False 12:34:05.025360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:34:06.277975 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:06.285813 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:34:06.318528 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:34:06.346576 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:34:06.399702 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:34:06.433689 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:34:06.460799 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:34:07.012238 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:34:07.063379 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:07.075070 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:34:07.142921 tst mo_mt_call.py: using LAC 40930 12:34:07.268510 tst mo_mt_call.py: using RAC 130 12:34:07.396583 tst mo_mt_call.py: using CellId 40930 12:34:07.522717 tst mo_mt_call.py: using BVCI 40931 12:34:07.638895 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:07.650681 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:07.662155 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:07.673604 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:07.685153 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:07.696631 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:34:07.817843 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:34:07.936155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:08.401927 run create_hlr_db(pid=22528): Launched 12:34:08.517257 bus /sierra_2: Setting Powered False 12:34:09.577206 run create_hlr_db(pid=22528): Terminated: ok {rc=0} 12:34:09.997143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22530): Launched 12:34:10.298559 run osmo-hlr_10.42.42.2(pid=22531): Launched 12:34:10.413440 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:10.943236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22533): Launched 12:34:11.244208 run osmo-stp_10.42.42.5(pid=22534): Launched 12:34:11.358213 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:11.900563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22536): Launched 12:34:12.202159 run osmo-msc_10.42.42.6(pid=22537): Launched 12:34:12.369464 run osmo-stp_10.42.42.5(pid=22534): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22534)] 12:34:12.497249 run osmo-stp_10.42.42.5(pid=22534): stdout: | (launched: 2022-12-14_12:34:11.188447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:12.624486 run osmo-stp_10.42.42.5(pid=22534): stderr: | [0;m[38;5;43m20221214123411360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123411360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123411360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123411361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123411361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123411361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123411361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:12.749763 run osmo-stp_10.42.42.5(pid=22534): stdout: | (launched: 2022-12-14_12:34:11.188447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:12.869848 run osmo-stp_10.42.42.5(pid=22534): stderr: | [0;m[38;5;43m20221214123411360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123411360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123411360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123411361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123411361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123411361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123411361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:13.012532 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22534): Process ended prematurely: osmo-stp_10.42.42.5(pid=22534) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22534)] [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:34:13.021439 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:34:13.047432 run osmo-hlr_10.42.42.2(pid=22531): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22531)] 12:34:13.094886 run osmo-hlr_10.42.42.2(pid=22531): stdout: | (launched: 2022-12-14_12:34:10.242432) 12:34:13.143553 run osmo-hlr_10.42.42.2(pid=22531): stderr: | [0;m[1;31m20221214123410421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123410421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123410422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123410422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123410422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123410422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123410437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123410445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123410445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123410445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:13.212090 run osmo-msc_10.42.42.6(pid=22537): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22537)] 12:34:13.258702 run osmo-msc_10.42.42.6(pid=22537): stdout: | (launched: 2022-12-14_12:34:12.145869) 12:34:13.307279 run osmo-msc_10.42.42.6(pid=22537): stderr: | [0;m[38;5;43m20221214123412416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123412416 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5a8ac0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123412417 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123412417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123412417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123412417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123412419 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123412419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123412419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123412419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:13.356053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22530): Terminating (SIGTERM) 12:34:13.395830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22533): Terminating (SIGTERM) 12:34:13.435233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22536): Terminating (SIGTERM) 12:34:13.475051 --- ParallelTerminationStrategy: PID 22530 died... 12:34:13.494351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22530): Terminated: ok {rc=0} 12:34:13.538144 --- ParallelTerminationStrategy: PID 22533 died... 12:34:13.557049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22533): Terminated: ok {rc=0} 12:34:13.600622 --- ParallelTerminationStrategy: PID 22536 died... 12:34:13.619361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22536): Terminated: ok {rc=0} 12:34:13.703054 bus /sierra_3: Setting Powered False 12:34:14.799082 bus /sierra_3: Setting Powered False 12:34:15.927620 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:34:17.102596 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:17.119383 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:34:17.208139 tst mo_mt_call_osmux.py: using LAC 40931 12:34:17.337782 tst mo_mt_call_osmux.py: using RAC 131 12:34:17.462785 tst mo_mt_call_osmux.py: using CellId 40931 12:34:17.588453 tst mo_mt_call_osmux.py: using BVCI 40932 12:34:17.704613 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:17.716443 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:17.727997 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:17.739447 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:17.751053 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:34:17.762500 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:34:17.879297 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:34:18.000819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:18.467943 run create_hlr_db(pid=22539): Launched 12:34:18.583104 bus /sierra_2: Setting Powered False 12:34:19.642809 run create_hlr_db(pid=22539): Terminated: ok {rc=0} 12:34:20.082223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22541): Launched 12:34:20.403596 run osmo-hlr_10.42.42.2(pid=22542): Launched 12:34:20.525998 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:21.079348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22544): Launched 12:34:21.401637 run osmo-stp_10.42.42.5(pid=22545): Launched 12:34:21.524932 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:22.108724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22547): Launched 12:34:22.430731 run osmo-msc_10.42.42.6(pid=22548): Launched 12:34:22.610688 run osmo-stp_10.42.42.5(pid=22545): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22545)] 12:34:22.746680 run osmo-stp_10.42.42.5(pid=22545): stdout: | (launched: 2022-12-14_12:34:21.342190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:22.883299 run osmo-stp_10.42.42.5(pid=22545): stderr: | [0;m[38;5;43m20221214123421535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123421535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123421535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123421535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123421536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123421536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123421536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:23.019055 run osmo-stp_10.42.42.5(pid=22545): stdout: | (launched: 2022-12-14_12:34:21.342190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:23.146809 run osmo-stp_10.42.42.5(pid=22545): stderr: | [0;m[38;5;43m20221214123421535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123421535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123421535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123421535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123421536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123421536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123421536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:23.299760 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22545): Process ended prematurely: osmo-stp_10.42.42.5(pid=22545) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22545)] [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:34:23.309695 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:34:23.337358 run osmo-hlr_10.42.42.2(pid=22542): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22542)] 12:34:23.387028 run osmo-hlr_10.42.42.2(pid=22542): stdout: | (launched: 2022-12-14_12:34:20.344382) 12:34:23.439389 run osmo-hlr_10.42.42.2(pid=22542): stderr: | [0;m[1;31m20221214123420545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123420545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123420545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123420545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123420545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123420545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123420557 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123420567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123420567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123420567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:23.511062 run osmo-msc_10.42.42.6(pid=22548): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22548)] 12:34:23.560449 run osmo-msc_10.42.42.6(pid=22548): stdout: | (launched: 2022-12-14_12:34:22.370668) 12:34:23.611311 run osmo-msc_10.42.42.6(pid=22548): stderr: | [0;m[38;5;43m20221214123422691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123422691 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd833bdac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123422691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123422691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123422691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123422692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123422693 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123422694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123422694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123422694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:23.662578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22541): Terminating (SIGTERM) 12:34:23.703921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22544): Terminating (SIGTERM) 12:34:23.745249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22547): Terminating (SIGTERM) 12:34:23.787464 --- ParallelTerminationStrategy: PID 22541 died... 12:34:23.807585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22541): Terminated: ok {rc=0} 12:34:23.853432 --- ParallelTerminationStrategy: PID 22544 died... 12:34:23.872848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22544): Terminated: ok {rc=0} 12:34:23.918496 --- ParallelTerminationStrategy: PID 22547 died... 12:34:23.938042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22547): Terminated: ok {rc=0} 12:34:24.024445 bus /sierra_3: Setting Powered False 12:34:25.122934 bus /sierra_3: Setting Powered False 12:34:26.238990 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:34:27.485382 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:27.492698 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:34:27.524791 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:34:27.552274 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:34:27.603487 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:34:27.635393 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:34:27.662382 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:34:28.215366 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:34:28.263739 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:28.275523 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:34:28.345629 tst mo_mt_call.py: using LAC 40932 12:34:28.472737 tst mo_mt_call.py: using RAC 132 12:34:28.597875 tst mo_mt_call.py: using CellId 40932 12:34:28.726984 tst mo_mt_call.py: using BVCI 40933 12:34:28.844621 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:28.856453 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:28.868163 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:28.879655 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:28.891446 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:28.903010 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:34:29.019069 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:34:29.142684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:29.641971 run create_hlr_db(pid=22553): Launched 12:34:29.772081 bus /sierra_2: Setting Powered False 12:34:30.841386 run create_hlr_db(pid=22553): Terminated: ok {rc=0} 12:34:31.409777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22555): Launched 12:34:31.761834 run osmo-hlr_10.42.42.2(pid=22556): Launched 12:34:31.989096 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:32.625325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22558): Launched 12:34:32.926048 run osmo-stp_10.42.42.5(pid=22559): Launched 12:34:33.039572 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:33.581848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22561): Launched 12:34:33.882105 run osmo-msc_10.42.42.6(pid=22562): Launched 12:34:34.049124 run osmo-stp_10.42.42.5(pid=22559): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22559)] 12:34:34.177214 run osmo-stp_10.42.42.5(pid=22559): stdout: | (launched: 2022-12-14_12:34:32.870409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:34.304649 run osmo-stp_10.42.42.5(pid=22559): stderr: | [0;m[38;5;43m20221214123433043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123433043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123433043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123433044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123433044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123433044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123433044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:34.429976 run osmo-stp_10.42.42.5(pid=22559): stdout: | (launched: 2022-12-14_12:34:32.870409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:34.549223 run osmo-stp_10.42.42.5(pid=22559): stderr: | [0;m[38;5;43m20221214123433043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123433043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123433043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123433044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123433044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123433044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123433044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:34.691937 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22559): Process ended prematurely: osmo-stp_10.42.42.5(pid=22559) [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22559)] [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:34:34.700874 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:34:34.727107 run osmo-hlr_10.42.42.2(pid=22556): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22556)] 12:34:34.774757 run osmo-hlr_10.42.42.2(pid=22556): stdout: | (launched: 2022-12-14_12:34:31.697485) 12:34:34.823605 run osmo-hlr_10.42.42.2(pid=22556): stderr: | [0;m[1;31m20221214123431895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123431895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123431895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123431895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123431895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123431895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123431955 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123431972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123431972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123431972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:34.892525 run osmo-msc_10.42.42.6(pid=22562): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22562)] 12:34:34.939501 run osmo-msc_10.42.42.6(pid=22562): stdout: | (launched: 2022-12-14_12:34:33.825822) 12:34:34.988521 run osmo-msc_10.42.42.6(pid=22562): stderr: | [0;m[38;5;43m20221214123434093 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123434094 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa0bbe5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123434094 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123434094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123434094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123434094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123434096 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123434096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123434096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123434097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:35.038397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22555): Terminating (SIGTERM) 12:34:35.078129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22558): Terminating (SIGTERM) 12:34:35.117951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22561): Terminating (SIGTERM) 12:34:35.157921 --- ParallelTerminationStrategy: PID 22555 died... 12:34:35.177295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22555): Terminated: ok {rc=0} 12:34:35.221222 --- ParallelTerminationStrategy: PID 22558 died... 12:34:35.240024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22558): Terminated: ok {rc=0} 12:34:35.283830 --- ParallelTerminationStrategy: PID 22561 died... 12:34:35.302642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22561): Terminated: ok {rc=0} 12:34:35.388042 bus /sierra_3: Setting Powered False 12:34:36.487120 bus /sierra_3: Setting Powered False 12:34:37.601416 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:34:38.746511 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:38.758529 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:34:38.825178 tst mo_mt_call_osmux.py: using LAC 40933 12:34:38.945447 tst mo_mt_call_osmux.py: using RAC 133 12:34:39.065490 tst mo_mt_call_osmux.py: using CellId 40933 12:34:39.184818 tst mo_mt_call_osmux.py: using BVCI 40934 12:34:39.293156 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:39.304245 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:39.315392 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:39.326418 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:39.337828 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:34:39.349207 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:34:39.469775 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:34:39.588403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:40.053381 run create_hlr_db(pid=22564): Launched 12:34:40.167329 bus /sierra_2: Setting Powered False 12:34:41.227457 run create_hlr_db(pid=22564): Terminated: ok {rc=0} 12:34:41.669172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22566): Launched 12:34:41.990190 run osmo-hlr_10.42.42.2(pid=22567): Launched 12:34:42.112448 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:42.667671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22569): Launched 12:34:42.989141 run osmo-stp_10.42.42.5(pid=22570): Launched 12:34:43.111916 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:43.693048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22572): Launched 12:34:44.014491 run osmo-msc_10.42.42.6(pid=22573): Launched 12:34:44.193204 run osmo-stp_10.42.42.5(pid=22570): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22570)] 12:34:44.327783 run osmo-stp_10.42.42.5(pid=22570): stdout: | (launched: 2022-12-14_12:34:42.929289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:44.463995 run osmo-stp_10.42.42.5(pid=22570): stderr: | [0;m[38;5;43m20221214123443122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123443122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123443122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123443123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123443125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123443125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123443125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:44.598679 run osmo-stp_10.42.42.5(pid=22570): stdout: | (launched: 2022-12-14_12:34:42.929289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:44.725790 run osmo-stp_10.42.42.5(pid=22570): stderr: | [0;m[38;5;43m20221214123443122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123443122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123443122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123443123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123443125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123443125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123443125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:44.877962 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22570): Process ended prematurely: osmo-stp_10.42.42.5(pid=22570) [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22570)] [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:34:44.887649 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:34:44.915518 run osmo-hlr_10.42.42.2(pid=22567): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22567)] 12:34:44.964917 run osmo-hlr_10.42.42.2(pid=22567): stdout: | (launched: 2022-12-14_12:34:41.930865) 12:34:45.015721 run osmo-hlr_10.42.42.2(pid=22567): stderr: | [0;m[1;31m20221214123442131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123442131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123442131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123442131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123442131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123442132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123442149 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123442158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123442158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123442158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:45.087050 run osmo-msc_10.42.42.6(pid=22573): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22573)] 12:34:45.136021 run osmo-msc_10.42.42.6(pid=22573): stdout: | (launched: 2022-12-14_12:34:43.954994) 12:34:45.186683 run osmo-msc_10.42.42.6(pid=22573): stderr: | [0;m[38;5;43m20221214123444275 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123444275 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2798e54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123444276 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123444276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123444276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123444276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123444278 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123444278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123444278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123444278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:45.237891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22566): Terminating (SIGTERM) 12:34:45.279058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22569): Terminating (SIGTERM) 12:34:45.320253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22572): Terminating (SIGTERM) 12:34:45.362360 --- ParallelTerminationStrategy: PID 22566 died... 12:34:45.382415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22566): Terminated: ok {rc=0} 12:34:45.428358 --- ParallelTerminationStrategy: PID 22569 died... 12:34:45.447946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22569): Terminated: ok {rc=0} 12:34:45.493574 --- ParallelTerminationStrategy: PID 22572 died... 12:34:45.513163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22572): Terminated: ok {rc=0} 12:34:45.600863 bus /sierra_3: Setting Powered False 12:34:46.696503 bus /sierra_3: Setting Powered False 12:34:47.814038 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:34:49.061081 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:34:49.068008 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:34:49.100206 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 12:34:49.128102 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 12:34:49.179996 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:34:49.212320 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 12:34:49.239040 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 12:34:49.796142 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 12:34:49.847809 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:34:49.859628 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:34:49.914554 tst mo_mt_call.py: using LAC 40934 12:34:50.040265 tst mo_mt_call.py: using RAC 134 12:34:50.168742 tst mo_mt_call.py: using CellId 40934 12:34:50.293420 tst mo_mt_call.py: using BVCI 40935 12:34:50.409993 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:34:50.422221 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:34:50.434181 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:34:50.446140 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:34:50.457920 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:34:50.469677 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:34:50.588385 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:34:50.706766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:34:51.207597 run create_hlr_db(pid=22578): Launched 12:34:51.337833 bus /sierra_2: Setting Powered False 12:34:52.401991 run create_hlr_db(pid=22578): Terminated: ok {rc=0} 12:34:52.833536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22580): Launched 12:34:53.134892 run osmo-hlr_10.42.42.2(pid=22581): Launched 12:34:53.248676 run osmo-stp_10.42.42.5: Starting osmo-stp 12:34:53.780035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22583): Launched 12:34:54.080186 run osmo-stp_10.42.42.5(pid=22584): Launched 12:34:54.195916 run osmo-msc_10.42.42.6: Starting osmo-msc 12:34:54.738165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22586): Launched 12:34:55.039009 run osmo-msc_10.42.42.6(pid=22587): Launched 12:34:55.206901 run osmo-stp_10.42.42.5(pid=22584): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22584)] 12:34:55.334693 run osmo-stp_10.42.42.5(pid=22584): stdout: | (launched: 2022-12-14_12:34:54.024139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:55.461913 run osmo-stp_10.42.42.5(pid=22584): stderr: | [0;m[38;5;43m20221214123454198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123454198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123454198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123454198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123454201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123454201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123454201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:55.587031 run osmo-stp_10.42.42.5(pid=22584): stdout: | (launched: 2022-12-14_12:34:54.024139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:34:55.706379 run osmo-stp_10.42.42.5(pid=22584): stderr: | [0;m[38;5;43m20221214123454198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123454198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123454198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123454198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123454201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123454201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123454201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:34:55.849135 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22584): Process ended prematurely: osmo-stp_10.42.42.5(pid=22584) [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22584)] [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 12:34:55.857939 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 12:34:55.884263 run osmo-hlr_10.42.42.2(pid=22581): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22581)] 12:34:55.931778 run osmo-hlr_10.42.42.2(pid=22581): stdout: | (launched: 2022-12-14_12:34:53.078694) 12:34:55.980459 run osmo-hlr_10.42.42.2(pid=22581): stderr: | [0;m[1;31m20221214123453255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123453255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123453255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123453255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123453256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123453256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123453268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123453278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123453279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123453279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:34:56.048870 run osmo-msc_10.42.42.6(pid=22587): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22587)] 12:34:56.095381 run osmo-msc_10.42.42.6(pid=22587): stdout: | (launched: 2022-12-14_12:34:54.982874) 12:34:56.143799 run osmo-msc_10.42.42.6(pid=22587): stderr: | [0;m[38;5;43m20221214123455253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123455253 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fee138e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123455253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123455253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123455254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123455254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123455255 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123455256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123455256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123455256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:34:56.192923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22580): Terminating (SIGTERM) 12:34:56.232718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22583): Terminating (SIGTERM) 12:34:56.272362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22586): Terminating (SIGTERM) 12:34:56.312211 --- ParallelTerminationStrategy: PID 22580 died... 12:34:56.331484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22580): Terminated: ok {rc=0} 12:34:56.375586 --- ParallelTerminationStrategy: PID 22583 died... 12:34:56.394368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22583): Terminated: ok {rc=0} 12:34:56.438298 --- ParallelTerminationStrategy: PID 22586 died... 12:34:56.457172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22586): Terminated: ok {rc=0} 12:34:56.543339 bus /sierra_3: Setting Powered False 12:34:57.641508 bus /sierra_3: Setting Powered False 12:34:58.753774 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 12:34:59.900345 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:34:59.913015 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:34:59.970337 tst mo_mt_call_osmux.py: using LAC 40935 12:35:00.095845 tst mo_mt_call_osmux.py: using RAC 135 12:35:00.219867 tst mo_mt_call_osmux.py: using CellId 40935 12:35:00.342943 tst mo_mt_call_osmux.py: using BVCI 40936 12:35:00.459686 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:35:00.471613 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:35:00.483460 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:35:00.495071 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:35:00.506839 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:35:00.519178 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:35:00.641428 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:35:00.760866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:01.259446 run create_hlr_db(pid=22589): Launched 12:35:01.431501 bus /sierra_2: Setting Powered False 12:35:02.497142 run create_hlr_db(pid=22589): Terminated: ok {rc=0} 12:35:02.927859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22594): Launched 12:35:03.229180 run osmo-hlr_10.42.42.2(pid=22595): Launched 12:35:03.345127 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:03.875153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22597): Launched 12:35:04.175610 run osmo-stp_10.42.42.5(pid=22598): Launched 12:35:04.289737 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:04.834801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22600): Launched 12:35:05.135593 run osmo-msc_10.42.42.6(pid=22601): Launched 12:35:05.303290 run osmo-stp_10.42.42.5(pid=22598): ERR: Terminated: ERROR {rc=1} [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22598)] 12:35:05.431116 run osmo-stp_10.42.42.5(pid=22598): stdout: | (launched: 2022-12-14_12:35:04.119453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:05.558944 run osmo-stp_10.42.42.5(pid=22598): stderr: | [0;m[38;5;43m20221214123504289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123504289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123504289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123504290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123504290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123504290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123504290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:05.684431 run osmo-stp_10.42.42.5(pid=22598): stdout: | (launched: 2022-12-14_12:35:04.119453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:05.803713 run osmo-stp_10.42.42.5(pid=22598): stderr: | [0;m[38;5;43m20221214123504289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123504289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123504289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123504290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123504290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123504290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123504290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:05.946836 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22598): Process ended prematurely: osmo-stp_10.42.42.5(pid=22598) [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22598)] [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 12:35:05.955966 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:35:05.982360 run osmo-hlr_10.42.42.2(pid=22595): ERR: Terminated: ERROR {rc=237} [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22595)] 12:35:06.030107 run osmo-hlr_10.42.42.2(pid=22595): stdout: | (launched: 2022-12-14_12:35:03.172745) 12:35:06.079177 run osmo-hlr_10.42.42.2(pid=22595): stderr: | [0;m[1;31m20221214123503350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123503350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123503350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123503350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123503350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123503351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123503362 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123503371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123503372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123503372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:06.147967 run osmo-msc_10.42.42.6(pid=22601): ERR: Terminated: ERROR {rc=2} [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22601)] 12:35:06.194867 run osmo-msc_10.42.42.6(pid=22601): stdout: | (launched: 2022-12-14_12:35:05.079357) 12:35:06.243690 run osmo-msc_10.42.42.6(pid=22601): stderr: | [0;m[38;5;43m20221214123505349 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123505349 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f75c217cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123505349 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123505349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123505349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123505350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123505351 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123505352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123505352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123505352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:06.293159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22594): Terminating (SIGTERM) 12:35:06.333202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22597): Terminating (SIGTERM) 12:35:06.373097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22600): Terminating (SIGTERM) 12:35:06.413361 --- ParallelTerminationStrategy: PID 22594 died... 12:35:06.432896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22594): Terminated: ok {rc=0} 12:35:06.476831 --- ParallelTerminationStrategy: PID 22597 died... 12:35:06.496294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22597): Terminated: ok {rc=0} 12:35:06.540364 --- ParallelTerminationStrategy: PID 22600 died... 12:35:06.559471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22600): Terminated: ok {rc=0} 12:35:06.645110 bus /sierra_3: Setting Powered False 12:35:07.744282 bus /sierra_3: Setting Powered False 12:35:08.858423 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 emergency:nanobts+band-900 --------------------------------------------------------------------- 12:35:10.116223 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:10.122778 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:35:10.154720 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:35:10.182473 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 12:35:10.264400 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:35:10.295872 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:35:10.322363 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 12:35:10.906983 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2404 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 12:35:10.912396 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:10.923143 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 12:35:10.970246 tst emergency_mo_mt_call.py: using LAC 40936 12:35:11.085384 tst emergency_mo_mt_call.py: using RAC 136 12:35:11.199378 tst emergency_mo_mt_call.py: using CellId 40936 12:35:11.313302 tst emergency_mo_mt_call.py: using BVCI 40937 12:35:11.419672 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:11.430499 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:11.441004 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:11.451958 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:11.462885 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:11.473814 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:35:11.591888 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:35:11.708062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:12.164273 run create_hlr_db(pid=22606): Launched 12:35:12.276926 bus /sierra_2: Setting Powered False 12:35:13.337191 run create_hlr_db(pid=22606): Terminated: ok {rc=0} 12:35:13.751268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22608): Launched 12:35:14.046559 run osmo-hlr_10.42.42.2(pid=22609): Launched 12:35:14.158064 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:14.679373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22611): Launched 12:35:14.975241 run osmo-stp_10.42.42.5(pid=22612): Launched 12:35:15.097158 tst emergency_mo_mt_call.py: using MSISDN 8681 12:35:15.261506 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:15.793542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22614): Launched 12:35:16.130800 run osmo-msc_10.42.42.6(pid=22615): Launched 12:35:16.533042 run osmo-stp_10.42.42.5(pid=22612): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22612)] 12:35:16.762192 run osmo-stp_10.42.42.5(pid=22612): stdout: | (launched: 2022-12-14_12:35:14.919937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:16.898213 run osmo-stp_10.42.42.5(pid=22612): stderr: | [0;m[38;5;43m20221214123515091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123515091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123515091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123515092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123515092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123515092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123515092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:17.033997 run osmo-stp_10.42.42.5(pid=22612): stdout: | (launched: 2022-12-14_12:35:14.919937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:17.163617 run osmo-stp_10.42.42.5(pid=22612): stderr: | [0;m[38;5;43m20221214123515091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123515091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123515091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123515092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123515092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123515092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123515092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:17.316471 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22612): Process ended prematurely: osmo-stp_10.42.42.5(pid=22612) [trial-2404↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22612)] [trial-2404↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 12:35:17.326028 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 12:35:17.353784 run osmo-hlr_10.42.42.2(pid=22609): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22609)] 12:35:17.404459 run osmo-hlr_10.42.42.2(pid=22609): stdout: | (launched: 2022-12-14_12:35:13.991339) 12:35:17.456715 run osmo-hlr_10.42.42.2(pid=22609): stderr: | [0;m[1;31m20221214123514167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123514167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123514167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123514168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123514168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123514168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123514180 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123514189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123514189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123514189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:17.529688 run osmo-msc_10.42.42.6(pid=22615): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22615)] 12:35:17.580022 run osmo-msc_10.42.42.6(pid=22615): stdout: | (launched: 2022-12-14_12:35:16.070329) 12:35:17.632287 run osmo-msc_10.42.42.6(pid=22615): stderr: | [0;m[38;5;43m20221214123516454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123516454 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f031c9d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123516454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123516454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123516455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123516455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123516469 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123516469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123516469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123516469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:17.684314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22608): Terminating (SIGTERM) 12:35:17.726106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22611): Terminating (SIGTERM) 12:35:17.767805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22614): Terminating (SIGTERM) 12:35:17.810315 --- ParallelTerminationStrategy: PID 22608 died... 12:35:17.830363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22608): Terminated: ok {rc=0} 12:35:17.876408 --- ParallelTerminationStrategy: PID 22611 died... 12:35:17.895979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22611): Terminated: ok {rc=0} 12:35:17.942001 --- ParallelTerminationStrategy: PID 22614 died... 12:35:17.961510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22614): Terminated: ok {rc=0} 12:35:18.048463 bus /sierra_3: Setting Powered False 12:35:19.146798 bus /sierra_3: Setting Powered False 12:35:20.264910 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 12:35:21.350837 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:21.362870 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 12:35:21.416157 tst emergency_preemptive_call.py: using LAC 40937 12:35:21.540883 tst emergency_preemptive_call.py: using RAC 137 12:35:21.662627 tst emergency_preemptive_call.py: using CellId 40937 12:35:21.784804 tst emergency_preemptive_call.py: using BVCI 40938 12:35:21.899564 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:21.910894 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:21.921967 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:21.932833 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:21.944362 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:35:21.955803 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:35:22.073766 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:35:22.195025 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:35:22.309268 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:35:22.426202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:22.917738 run create_hlr_db(pid=22617): Launched 12:35:23.045376 bus /sierra_2: Setting Powered False 12:35:24.108463 run create_hlr_db(pid=22617): Terminated: ok {rc=0} 12:35:24.533891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22619): Launched 12:35:24.830611 run osmo-hlr_10.42.42.2(pid=22620): Launched 12:35:24.942766 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:25.466636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22622): Launched 12:35:25.762172 run osmo-stp_10.42.42.5(pid=22623): Launched 12:35:25.886543 tst emergency_preemptive_call.py: using MSISDN 8682 12:35:26.037316 run osmo-msc_10.42.42.6: Starting osmo-msc 12:35:26.567660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22625): Launched 12:35:26.863135 run osmo-msc_10.42.42.6(pid=22626): Launched 12:35:27.027826 run osmo-stp_10.42.42.5(pid=22623): ERR: Terminated: ERROR {rc=1} [trial-2404↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22623)] 12:35:27.153990 run osmo-stp_10.42.42.5(pid=22623): stdout: | (launched: 2022-12-14_12:35:25.706738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:27.279957 run osmo-stp_10.42.42.5(pid=22623): stderr: | [0;m[38;5;43m20221214123525876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123525877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123525877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123525878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123525878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123525878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123525878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:27.404059 run osmo-stp_10.42.42.5(pid=22623): stdout: | (launched: 2022-12-14_12:35:25.706738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:27.532498 run osmo-stp_10.42.42.5(pid=22623): stderr: | [0;m[38;5;43m20221214123525876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123525877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123525877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123525878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123525878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123525878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123525878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:27.683288 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22623): Process ended prematurely: osmo-stp_10.42.42.5(pid=22623) [trial-2404↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22623)] [trial-2404↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 12:35:27.692110 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 12:35:27.719521 run osmo-hlr_10.42.42.2(pid=22620): ERR: Terminated: ERROR {rc=237} [trial-2404↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22620)] 12:35:27.769388 run osmo-hlr_10.42.42.2(pid=22620): stdout: | (launched: 2022-12-14_12:35:24.774981) 12:35:27.820519 run osmo-hlr_10.42.42.2(pid=22620): stderr: | [0;m[1;31m20221214123524954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123524955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123524955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123524955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123524955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123524955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123524967 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123524976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123524976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123524976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:27.892107 run osmo-msc_10.42.42.6(pid=22626): ERR: Terminated: ERROR {rc=2} [trial-2404↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22626)] 12:35:27.941532 run osmo-msc_10.42.42.6(pid=22626): stdout: | (launched: 2022-12-14_12:35:26.807856) 12:35:27.992626 run osmo-msc_10.42.42.6(pid=22626): stderr: | [0;m[38;5;43m20221214123527077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214123527077 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff9e2499c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214123527077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214123527077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214123527078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214123527078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214123527079 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214123527080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214123527080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214123527080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:35:28.043744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22619): Terminating (SIGTERM) 12:35:28.084912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22622): Terminating (SIGTERM) 12:35:28.126721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22625): Terminating (SIGTERM) 12:35:28.168358 --- ParallelTerminationStrategy: PID 22619 died... 12:35:28.188247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22619): Terminated: ok {rc=0} 12:35:28.233814 --- ParallelTerminationStrategy: PID 22622 died... 12:35:28.253250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22622): Terminated: ok {rc=0} 12:35:28.298963 --- ParallelTerminationStrategy: PID 22625 died... 12:35:28.318411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22625): Terminated: ok {rc=0} 12:35:28.405908 bus /sierra_9: Setting Powered False 12:35:29.504539 bus /sierra_9: Setting Powered False 12:35:30.620936 bus /sierra_8: Setting Powered False 12:35:31.722580 bus /sierra_8: Setting Powered False 12:35:32.857026 bus /sierra_3: Setting Powered False 12:35:33.954690 bus /sierra_3: Setting Powered False 12:35:35.069958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-900 --------------------------------------------------------------------- 12:35:36.348732 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:35:36.354367 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:35:36.387156 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 12:35:36.426436 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 12:35:36.514973 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:35:36.547820 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 12:35:36.587218 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 12:35:37.180506 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 12:35:37.232722 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:37.243852 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:35:37.291817 tst cs_paging_gprs_active.py: using LAC 40938 12:35:37.411426 tst cs_paging_gprs_active.py: using RAC 138 12:35:37.540517 tst cs_paging_gprs_active.py: using CellId 40938 12:35:37.659549 tst cs_paging_gprs_active.py: using BVCI 40939 12:35:37.768526 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:37.779392 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:37.790095 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:37.800434 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:37.811479 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:37.822369 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:37.833410 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:37.843923 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:37.854911 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:35:37.975005 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:35:38.095595 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:35:38.298158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:35:38.601970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22631): Launched 12:35:38.864805 run iperf3-srv_10.42.42.10(pid=22632): Launched 12:35:38.977398 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:35:39.178222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:35:39.481123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22633): Launched 12:35:39.744203 run iperf3-srv_10.42.42.10(pid=22634): Launched 12:35:39.856484 tst cs_paging_gprs_active.py:38: start network... 12:35:40.057658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:40.522580 run create_hlr_db(pid=22635): Launched 12:35:40.654193 bus /sierra_2: Setting Powered False 12:35:41.717909 run create_hlr_db(pid=22635): Terminated: ok {rc=0} 12:35:42.148634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22637): Launched 12:35:42.451429 run osmo-hlr_10.42.42.2(pid=22638): Launched 12:35:42.566854 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:43.085394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22640): Launched 12:35:43.387705 run osmo-stp_10.42.42.5(pid=22641): Launched 12:35:43.502027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:35:44.020464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22643): Launched 12:35:44.135616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:35:44.390626 run patchelf(pid=22644): Launched 12:35:44.557955 run osmo-stp_10.42.42.5(pid=22641): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22641)] 12:35:44.685602 run osmo-stp_10.42.42.5(pid=22641): stdout: | (launched: 2022-12-14_12:35:43.331237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:44.815782 run osmo-stp_10.42.42.5(pid=22641): stderr: | [0;m[38;5;43m20221214123543499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123543500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123543500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123543500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123543501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123543501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123543501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:44.945686 run osmo-stp_10.42.42.5(pid=22641): stdout: | (launched: 2022-12-14_12:35:43.331237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:45.069332 run osmo-stp_10.42.42.5(pid=22641): stderr: | [0;m[38;5;43m20221214123543499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123543500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123543500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123543500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123543501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123543501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123543501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:45.215756 run patchelf(pid=22644): Terminating (SIGINT) 12:35:45.384778 run patchelf(pid=22644): Terminated: ok {rc=0} 12:35:45.507154 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22641): Process ended prematurely: osmo-stp_10.42.42.5(pid=22641) [trial-2404↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22641)] [trial-2404↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 12:35:45.516687 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 12:35:45.543669 run osmo-hlr_10.42.42.2(pid=22638): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22638)] 12:35:45.591513 run osmo-hlr_10.42.42.2(pid=22638): stdout: | (launched: 2022-12-14_12:35:42.395078) 12:35:45.640384 run osmo-hlr_10.42.42.2(pid=22638): stderr: | [0;m[1;31m20221214123542571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123542571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123542571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123542571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123542571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123542571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123542583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123542593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123542593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123542594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:45.689399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22631): Terminating (SIGTERM) 12:35:45.728835 run iperf3-srv_10.42.42.10(pid=22632): Terminating (SIGTERM) 12:35:45.768439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22633): Terminating (SIGTERM) 12:35:45.808007 run iperf3-srv_10.42.42.10(pid=22634): Terminating (SIGTERM) 12:35:45.862023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22637): Terminating (SIGTERM) 12:35:45.908283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22640): Terminating (SIGTERM) 12:35:45.951593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22643): Terminating (SIGTERM) 12:35:45.993552 --- ParallelTerminationStrategy: PID 22631 died... 12:35:46.014160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22631): Terminated: ok {rc=0} 12:35:46.060294 --- ParallelTerminationStrategy: PID 22632 died... 12:35:46.080886 run iperf3-srv_10.42.42.10(pid=22632): Terminated {rc=256} 12:35:46.126971 --- ParallelTerminationStrategy: PID 22633 died... 12:35:46.147523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22633): Terminated: ok {rc=0} 12:35:46.192889 --- ParallelTerminationStrategy: PID 22634 died... 12:35:46.213135 run iperf3-srv_10.42.42.10(pid=22634): Terminated {rc=256} 12:35:46.258345 --- ParallelTerminationStrategy: PID 22637 died... 12:35:46.278444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22637): Terminated: ok {rc=0} 12:35:46.323884 --- ParallelTerminationStrategy: PID 22640 died... 12:35:46.344011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22640): Terminated: ok {rc=0} 12:35:46.389801 --- ParallelTerminationStrategy: PID 22643 died... 12:35:46.410189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22643): Terminated: ok {rc=0} 12:35:46.497587 bus /gobi_0: Setting Powered False 12:35:47.593988 bus /gobi_0: Setting Powered False 12:35:48.707408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 12:35:49.855881 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:49.867628 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:35:49.922445 tst iperf3.py: using LAC 40939 12:35:50.055465 tst iperf3.py: using RAC 139 12:35:50.175409 tst iperf3.py: using CellId 40939 12:35:50.294174 tst iperf3.py: using BVCI 40940 12:35:50.402973 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:50.413909 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:50.424677 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:50.435162 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:50.445958 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:50.456614 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:50.467602 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:50.478444 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:50.489402 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:35:50.603357 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:35:50.804930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:35:51.108634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22645): Launched 12:35:51.372573 run iperf3-srv_10.42.42.10(pid=22646): Launched 12:35:51.486000 tst iperf3.py:8: start network... 12:35:51.687361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:35:52.170444 run create_hlr_db(pid=22650): Launched 12:35:52.301714 bus /gobi_6: Setting Powered False 12:35:53.365764 run create_hlr_db(pid=22650): Terminated: ok {rc=0} 12:35:53.817194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22652): Launched 12:35:54.139007 run osmo-hlr_10.42.42.2(pid=22653): Launched 12:35:54.260772 run osmo-stp_10.42.42.5: Starting osmo-stp 12:35:54.816760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22655): Launched 12:35:55.138879 run osmo-stp_10.42.42.5(pid=22656): Launched 12:35:55.260526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:35:55.818240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22658): Launched 12:35:55.940818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:35:56.213799 run patchelf(pid=22659): Launched 12:35:56.392310 run osmo-stp_10.42.42.5(pid=22656): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22656)] 12:35:56.529254 run osmo-stp_10.42.42.5(pid=22656): stdout: | (launched: 2022-12-14_12:35:55.079039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:56.667288 run osmo-stp_10.42.42.5(pid=22656): stderr: | [0;m[38;5;43m20221214123555271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123555272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123555272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123555272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123555273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123555273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123555273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:56.805337 run osmo-stp_10.42.42.5(pid=22656): stdout: | (launched: 2022-12-14_12:35:55.079039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:35:56.937502 run osmo-stp_10.42.42.5(pid=22656): stderr: | [0;m[38;5;43m20221214123555271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123555272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123555272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123555272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123555273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123555273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123555273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:35:57.093914 run patchelf(pid=22659): Terminating (SIGINT) 12:35:57.274465 run patchelf(pid=22659): Terminated: ok {rc=0} 12:35:57.404481 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22656): Process ended prematurely: osmo-stp_10.42.42.5(pid=22656) [trial-2404↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22656)] [trial-2404↪gprs:nanobts+band-900↪iperf3.py:8] 12:35:57.414772 tst iperf3.py:8: Test FAILED (7.6 sec) 12:35:57.443351 run osmo-hlr_10.42.42.2(pid=22653): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22653)] 12:35:57.493980 run osmo-hlr_10.42.42.2(pid=22653): stdout: | (launched: 2022-12-14_12:35:54.079296) 12:35:57.546182 run osmo-hlr_10.42.42.2(pid=22653): stderr: | [0;m[1;31m20221214123554278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123554278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123554278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123554278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123554278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123554278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123554289 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123554298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123554298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123554298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:35:57.598230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22645): Terminating (SIGTERM) 12:35:57.640216 run iperf3-srv_10.42.42.10(pid=22646): Terminating (SIGTERM) 12:35:57.682798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22652): Terminating (SIGTERM) 12:35:57.725029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22655): Terminating (SIGTERM) 12:35:57.766968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22658): Terminating (SIGTERM) 12:35:57.809177 --- ParallelTerminationStrategy: PID 22645 died... 12:35:57.829254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22645): Terminated: ok {rc=0} 12:35:57.875542 --- ParallelTerminationStrategy: PID 22646 died... 12:35:57.895226 run iperf3-srv_10.42.42.10(pid=22646): Terminated {rc=256} 12:35:57.941340 --- ParallelTerminationStrategy: PID 22652 died... 12:35:57.960993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22652): Terminated: ok {rc=0} 12:35:58.007246 --- ParallelTerminationStrategy: PID 22655 died... 12:35:58.027014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22655): Terminated: ok {rc=0} 12:35:58.073372 --- ParallelTerminationStrategy: PID 22658 died... 12:35:58.093074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22658): Terminated: ok {rc=0} 12:35:58.181278 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 12:35:59.331877 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:59.343840 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:35:59.392826 tst iperf3m4.py: using LAC 40940 12:35:59.520864 tst iperf3m4.py: using RAC 140 12:35:59.647109 tst iperf3m4.py: using CellId 40940 12:35:59.776507 tst iperf3m4.py: using BVCI 40941 12:35:59.894880 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:59.906311 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:59.917587 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:59.928436 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:59.939442 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:59.950431 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:59.961692 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:59.972536 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:35:59.983652 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:36:00.100506 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:36:00.222379 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:36:00.339206 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:36:00.459676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:36:00.678337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:36:01.023794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22660): Launched 12:36:01.306097 run iperf3-srv_10.42.42.10(pid=22661): Launched 12:36:01.439567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:36:01.650197 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:36:01.979270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22662): Launched 12:36:02.256470 run iperf3-srv_10.42.42.10(pid=22663): Launched 12:36:02.369806 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:36:02.570757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:36:02.874176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22664): Launched 12:36:03.136473 run iperf3-srv_10.42.42.10(pid=22665): Launched 12:36:03.249305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:36:03.449815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:36:03.752765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22666): Launched 12:36:04.015793 run iperf3-srv_10.42.42.10(pid=22667): Launched 12:36:04.128571 tst iperf3m4.py:8: start network... 12:36:04.329403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:04.796191 run create_hlr_db(pid=22668): Launched 12:36:04.911780 bus /gobi_6: Setting Powered False 12:36:05.972005 run create_hlr_db(pid=22668): Terminated: ok {rc=0} 12:36:06.394018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22670): Launched 12:36:06.697573 run osmo-hlr_10.42.42.2(pid=22671): Launched 12:36:06.812658 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:07.348768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22673): Launched 12:36:07.652792 run osmo-stp_10.42.42.5(pid=22674): Launched 12:36:07.768157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:36:08.288416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22676): Launched 12:36:08.403805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:36:08.658925 run patchelf(pid=22677): Launched 12:36:08.826007 run osmo-stp_10.42.42.5(pid=22674): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22674)] 12:36:08.953719 run osmo-stp_10.42.42.5(pid=22674): stdout: | (launched: 2022-12-14_12:36:07.596202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:09.083033 run osmo-stp_10.42.42.5(pid=22674): stderr: | [0;m[38;5;43m20221214123607765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123607766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123607766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123607766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123607767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123607767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123607767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:09.212424 run osmo-stp_10.42.42.5(pid=22674): stdout: | (launched: 2022-12-14_12:36:07.596202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:09.335678 run osmo-stp_10.42.42.5(pid=22674): stderr: | [0;m[38;5;43m20221214123607765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123607766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123607766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123607766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123607767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123607767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123607767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:09.481785 run patchelf(pid=22677): Terminating (SIGINT) 12:36:09.650993 run patchelf(pid=22677): Terminated: ok {rc=0} 12:36:09.773699 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22674): Process ended prematurely: osmo-stp_10.42.42.5(pid=22674) [trial-2404↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22674)] [trial-2404↪gprs:nanobts+band-900↪iperf3m4.py:8] 12:36:09.783188 tst iperf3m4.py:8: Test FAILED (10.5 sec) 12:36:09.810558 run osmo-hlr_10.42.42.2(pid=22671): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22671)] 12:36:09.858694 run osmo-hlr_10.42.42.2(pid=22671): stdout: | (launched: 2022-12-14_12:36:06.640893) 12:36:09.907877 run osmo-hlr_10.42.42.2(pid=22671): stderr: | [0;m[1;31m20221214123606815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123606815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123606815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123606815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123606815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123606815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123606827 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123606835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123606836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123606836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:09.957644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22660): Terminating (SIGTERM) 12:36:09.997861 run iperf3-srv_10.42.42.10(pid=22661): Terminating (SIGTERM) 12:36:10.037735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22662): Terminating (SIGTERM) 12:36:10.077821 run iperf3-srv_10.42.42.10(pid=22663): Terminating (SIGTERM) 12:36:10.117719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22664): Terminating (SIGTERM) 12:36:10.157730 run iperf3-srv_10.42.42.10(pid=22665): Terminating (SIGTERM) 12:36:10.197441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22666): Terminating (SIGTERM) 12:36:10.237400 run iperf3-srv_10.42.42.10(pid=22667): Terminating (SIGTERM) 12:36:10.277264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22670): Terminating (SIGTERM) 12:36:10.317617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22673): Terminating (SIGTERM) 12:36:10.357349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22676): Terminating (SIGTERM) 12:36:10.397785 --- ParallelTerminationStrategy: PID 22660 died... 12:36:10.417196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22660): Terminated: ok {rc=0} 12:36:10.461183 --- ParallelTerminationStrategy: PID 22661 died... 12:36:10.479883 run iperf3-srv_10.42.42.10(pid=22661): Terminated {rc=256} 12:36:10.523582 --- ParallelTerminationStrategy: PID 22662 died... 12:36:10.542363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22662): Terminated: ok {rc=0} 12:36:10.585805 --- ParallelTerminationStrategy: PID 22663 died... 12:36:10.604473 run iperf3-srv_10.42.42.10(pid=22663): Terminated {rc=256} 12:36:10.648101 --- ParallelTerminationStrategy: PID 22664 died... 12:36:10.666925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22664): Terminated: ok {rc=0} 12:36:10.710685 --- ParallelTerminationStrategy: PID 22665 died... 12:36:10.729791 run iperf3-srv_10.42.42.10(pid=22665): Terminated {rc=256} 12:36:10.773373 --- ParallelTerminationStrategy: PID 22666 died... 12:36:10.792252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22666): Terminated: ok {rc=0} 12:36:10.836030 --- ParallelTerminationStrategy: PID 22667 died... 12:36:10.854895 run iperf3-srv_10.42.42.10(pid=22667): Terminated {rc=256} 12:36:10.898469 --- ParallelTerminationStrategy: PID 22670 died... 12:36:10.917316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22670): Terminated: ok {rc=0} 12:36:10.961613 --- ParallelTerminationStrategy: PID 22673 died... 12:36:10.980447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22673): Terminated: ok {rc=0} 12:36:11.024168 --- ParallelTerminationStrategy: PID 22676 died... 12:36:11.043205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22676): Terminated: ok {rc=0} 12:36:11.128550 bus /gobi_4: Setting Powered False 12:36:12.227318 bus /gobi_4: Setting Powered False 12:36:13.340349 bus /gobi_1: Setting Powered False 12:36:14.437925 bus /gobi_1: Setting Powered False 12:36:15.554281 bus /gobi_0: Setting Powered False 12:36:16.658728 bus /gobi_0: Setting Powered False 12:36:17.789077 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900 ping.py ---------------------------------------------- 12:36:18.894251 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:18.906024 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:36:18.954853 tst ping.py: using LAC 40941 12:36:19.081511 tst ping.py: using RAC 141 12:36:19.206106 tst ping.py: using CellId 40941 12:36:19.332366 tst ping.py: using BVCI 40942 12:36:19.449432 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:19.460551 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:19.471553 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:19.482825 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:19.494163 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:19.505539 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:19.517116 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:19.528611 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:36:19.647488 tst ping.py:19: start network... 12:36:19.861855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:20.352451 run create_hlr_db(pid=22678): Launched 12:36:20.480920 bus /gobi_6: Setting Powered False 12:36:21.543365 run create_hlr_db(pid=22678): Terminated: ok {rc=0} 12:36:21.968599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22680): Launched 12:36:22.264165 run osmo-hlr_10.42.42.2(pid=22681): Launched 12:36:22.376937 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:22.902248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22683): Launched 12:36:23.197279 run osmo-stp_10.42.42.5(pid=22684): Launched 12:36:23.310038 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:36:23.820748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22686): Launched 12:36:23.934625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:36:24.185000 run patchelf(pid=22687): Launched 12:36:24.349266 run osmo-stp_10.42.42.5(pid=22684): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22684)] 12:36:24.475123 run osmo-stp_10.42.42.5(pid=22684): stdout: | (launched: 2022-12-14_12:36:23.141927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:24.602540 run osmo-stp_10.42.42.5(pid=22684): stderr: | [0;m[38;5;43m20221214123623315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123623315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123623315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123623316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123623316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123623316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123623316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:24.729780 run osmo-stp_10.42.42.5(pid=22684): stdout: | (launched: 2022-12-14_12:36:23.141927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:24.850838 run osmo-stp_10.42.42.5(pid=22684): stderr: | [0;m[38;5;43m20221214123623315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123623315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123623315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123623316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123623316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123623316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123623316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:24.994145 run patchelf(pid=22687): Terminating (SIGINT) 12:36:25.160085 run patchelf(pid=22687): Terminated: ok {rc=0} 12:36:25.279551 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22684): Process ended prematurely: osmo-stp_10.42.42.5(pid=22684) [trial-2404↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22684)] [trial-2404↪gprs:nanobts+band-900↪ping.py:22] 12:36:25.288447 tst ping.py:22: Test FAILED (6.4 sec) 12:36:25.315284 run osmo-hlr_10.42.42.2(pid=22681): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22681)] 12:36:25.363636 run osmo-hlr_10.42.42.2(pid=22681): stdout: | (launched: 2022-12-14_12:36:22.209160) 12:36:25.413538 run osmo-hlr_10.42.42.2(pid=22681): stderr: | [0;m[1;31m20221214123622387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123622387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123622387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123622387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123622387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123622387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123622402 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123622412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123622412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123622412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:25.463641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22680): Terminating (SIGTERM) 12:36:25.504066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22683): Terminating (SIGTERM) 12:36:25.544618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22686): Terminating (SIGTERM) 12:36:25.585612 --- ParallelTerminationStrategy: PID 22680 died... 12:36:25.604585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22680): Terminated: ok {rc=0} 12:36:25.649592 --- ParallelTerminationStrategy: PID 22683 died... 12:36:25.668541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22683): Terminated: ok {rc=0} 12:36:25.712829 --- ParallelTerminationStrategy: PID 22686 died... 12:36:25.732166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22686): Terminated: ok {rc=0} 12:36:25.816777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 12:36:26.903294 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:26.915349 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:36:26.965683 tst ping_idle_ping.py: using LAC 40942 12:36:27.092376 tst ping_idle_ping.py: using RAC 142 12:36:27.218482 tst ping_idle_ping.py: using CellId 40942 12:36:27.342674 tst ping_idle_ping.py: using BVCI 40943 12:36:27.457791 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:27.468877 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:27.480280 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:27.491311 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:27.502383 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:27.513337 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:27.524428 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:36:27.535634 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:36:27.651201 tst ping_idle_ping.py:24: start network... 12:36:27.849959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:28.313205 run create_hlr_db(pid=22688): Launched 12:36:28.426127 bus /gobi_6: Setting Powered False 12:36:29.485895 run create_hlr_db(pid=22688): Terminated: ok {rc=0} 12:36:29.901079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22690): Launched 12:36:30.197854 run osmo-hlr_10.42.42.2(pid=22691): Launched 12:36:30.310370 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:30.852624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22693): Launched 12:36:31.202696 run osmo-stp_10.42.42.5(pid=22694): Launched 12:36:31.320853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:36:32.054198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22696): Launched 12:36:32.183281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:36:32.438502 run patchelf(pid=22697): Launched 12:36:32.603068 run osmo-stp_10.42.42.5(pid=22694): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22694)] 12:36:32.729054 run osmo-stp_10.42.42.5(pid=22694): stdout: | (launched: 2022-12-14_12:36:31.144014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:32.856487 run osmo-stp_10.42.42.5(pid=22694): stderr: | [0;m[38;5;43m20221214123631455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123631455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123631455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123631456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123631456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123631456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123631456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:32.983921 run osmo-stp_10.42.42.5(pid=22694): stdout: | (launched: 2022-12-14_12:36:31.144014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:33.105247 run osmo-stp_10.42.42.5(pid=22694): stderr: | [0;m[38;5;43m20221214123631455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123631455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123631455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123631456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123631456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123631456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123631456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:33.248701 run patchelf(pid=22697): Terminating (SIGINT) 12:36:33.415375 run patchelf(pid=22697): Terminated: ok {rc=0} 12:36:33.535363 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22694): Process ended prematurely: osmo-stp_10.42.42.5(pid=22694) [trial-2404↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22694)] [trial-2404↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 12:36:33.544096 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:36:33.570771 run osmo-hlr_10.42.42.2(pid=22691): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22691)] 12:36:33.618789 run osmo-hlr_10.42.42.2(pid=22691): stdout: | (launched: 2022-12-14_12:36:30.142678) 12:36:33.668348 run osmo-hlr_10.42.42.2(pid=22691): stderr: | [0;m[1;31m20221214123630317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123630317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123630317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123630317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123630317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123630318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123630329 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123630338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123630338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123630338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:33.718044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22690): Terminating (SIGTERM) 12:36:33.758127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22693): Terminating (SIGTERM) 12:36:33.798029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22696): Terminating (SIGTERM) 12:36:33.838240 --- ParallelTerminationStrategy: PID 22690 died... 12:36:33.857660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22690): Terminated: ok {rc=0} 12:36:33.901947 --- ParallelTerminationStrategy: PID 22693 died... 12:36:33.920818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22693): Terminated: ok {rc=0} 12:36:33.965829 --- ParallelTerminationStrategy: PID 22696 died... 12:36:33.984991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22696): Terminated: ok {rc=0} 12:36:34.071394 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 12:36:35.378747 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:35.385999 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:36:35.419563 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:36:35.459072 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:36:35.548324 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:36:35.581395 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:36:35.620757 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:36:36.223416 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:36:36.275840 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:36.287373 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:36:36.337191 tst cs_paging_gprs_active.py: using LAC 40943 12:36:36.463737 tst cs_paging_gprs_active.py: using RAC 143 12:36:36.584912 tst cs_paging_gprs_active.py: using CellId 40943 12:36:36.703463 tst cs_paging_gprs_active.py: using BVCI 40944 12:36:36.812452 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:36.823495 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:36.834307 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:36.844910 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:36.855795 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:36.866738 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:36.877804 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:36.888624 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:36.899781 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:36:37.020583 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:36:37.138960 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:36:37.342697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:36:37.648487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22701): Launched 12:36:37.913899 run iperf3-srv_10.42.42.10(pid=22702): Launched 12:36:38.027561 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:36:38.229351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:36:38.533749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22703): Launched 12:36:38.797714 run iperf3-srv_10.42.42.10(pid=22704): Launched 12:36:38.911002 tst cs_paging_gprs_active.py:38: start network... 12:36:39.112317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:39.582427 run create_hlr_db(pid=22705): Launched 12:36:39.697271 bus /gobi_6: Setting Powered False 12:36:40.757837 run create_hlr_db(pid=22705): Terminated: ok {rc=0} 12:36:41.201199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22707): Launched 12:36:41.526438 run osmo-hlr_10.42.42.2(pid=22708): Launched 12:36:41.652400 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:42.215807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22710): Launched 12:36:42.541185 run osmo-stp_10.42.42.5(pid=22711): Launched 12:36:42.664895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:36:43.224102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22713): Launched 12:36:43.347816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:36:43.623377 run patchelf(pid=22714): Launched 12:36:43.803503 run osmo-stp_10.42.42.5(pid=22711): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22711)] 12:36:43.940442 run osmo-stp_10.42.42.5(pid=22711): stdout: | (launched: 2022-12-14_12:36:42.480472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:44.079646 run osmo-stp_10.42.42.5(pid=22711): stderr: | [0;m[38;5;43m20221214123642672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123642672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123642673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123642673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123642673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123642674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123642674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:44.218263 run osmo-stp_10.42.42.5(pid=22711): stdout: | (launched: 2022-12-14_12:36:42.480472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:44.350812 run osmo-stp_10.42.42.5(pid=22711): stderr: | [0;m[38;5;43m20221214123642672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123642672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123642673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123642673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123642673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123642674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123642674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:44.508340 run patchelf(pid=22714): Terminating (SIGINT) 12:36:44.689875 run patchelf(pid=22714): Terminated: ok {rc=0} 12:36:44.820123 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22711): Process ended prematurely: osmo-stp_10.42.42.5(pid=22711) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22711)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:36:44.830236 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:36:44.858530 run osmo-hlr_10.42.42.2(pid=22708): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22708)] 12:36:44.907825 run osmo-hlr_10.42.42.2(pid=22708): stdout: | (launched: 2022-12-14_12:36:41.465925) 12:36:44.958919 run osmo-hlr_10.42.42.2(pid=22708): stderr: | [0;m[1;31m20221214123641664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123641665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123641665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123641665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123641665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123641665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123641675 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123641684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123641684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123641684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:45.010525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22701): Terminating (SIGTERM) 12:36:45.051932 run iperf3-srv_10.42.42.10(pid=22702): Terminating (SIGTERM) 12:36:45.094572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22703): Terminating (SIGTERM) 12:36:45.136218 run iperf3-srv_10.42.42.10(pid=22704): Terminating (SIGTERM) 12:36:45.177737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22707): Terminating (SIGTERM) 12:36:45.219058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22710): Terminating (SIGTERM) 12:36:45.260540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22713): Terminating (SIGTERM) 12:36:45.302016 --- ParallelTerminationStrategy: PID 22701 died... 12:36:45.321889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22701): Terminated: ok {rc=0} 12:36:45.367148 --- ParallelTerminationStrategy: PID 22702 died... 12:36:45.386362 run iperf3-srv_10.42.42.10(pid=22702): Terminated {rc=256} 12:36:45.431762 --- ParallelTerminationStrategy: PID 22703 died... 12:36:45.451228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22703): Terminated: ok {rc=0} 12:36:45.497095 --- ParallelTerminationStrategy: PID 22704 died... 12:36:45.516274 run iperf3-srv_10.42.42.10(pid=22704): Terminated {rc=256} 12:36:45.561704 --- ParallelTerminationStrategy: PID 22707 died... 12:36:45.581044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22707): Terminated: ok {rc=0} 12:36:45.626183 --- ParallelTerminationStrategy: PID 22710 died... 12:36:45.645448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22710): Terminated: ok {rc=0} 12:36:45.690733 --- ParallelTerminationStrategy: PID 22713 died... 12:36:45.710318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22713): Terminated: ok {rc=0} 12:36:45.796787 bus /gobi_0: Setting Powered False 12:36:46.922103 bus /gobi_0: Setting Powered False 12:36:48.034952 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:36:49.183669 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:49.195649 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:36:49.248556 tst iperf3.py: using LAC 40944 12:36:49.375154 tst iperf3.py: using RAC 144 12:36:49.502162 tst iperf3.py: using CellId 40944 12:36:49.629285 tst iperf3.py: using BVCI 40945 12:36:49.746824 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:49.758354 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:49.769596 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:49.780677 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:49.791792 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:49.802853 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:49.814170 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:49.825295 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:49.836663 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:36:49.953120 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:36:50.156735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:36:50.462455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22715): Launched 12:36:50.727973 run iperf3-srv_10.42.42.10(pid=22716): Launched 12:36:50.841748 tst iperf3.py:8: start network... 12:36:51.044274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:51.512586 run create_hlr_db(pid=22717): Launched 12:36:51.628614 bus /gobi_6: Setting Powered False 12:36:52.688904 run create_hlr_db(pid=22717): Terminated: ok {rc=0} 12:36:53.133353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22719): Launched 12:36:53.457767 run osmo-hlr_10.42.42.2(pid=22720): Launched 12:36:53.582989 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:54.147148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22722): Launched 12:36:54.471151 run osmo-stp_10.42.42.5(pid=22723): Launched 12:36:54.594874 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:36:55.153598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22725): Launched 12:36:55.277796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:36:55.553270 run patchelf(pid=22726): Launched 12:36:55.733045 run osmo-stp_10.42.42.5(pid=22723): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22723)] 12:36:55.870185 run osmo-stp_10.42.42.5(pid=22723): stdout: | (launched: 2022-12-14_12:36:54.411105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:56.008481 run osmo-stp_10.42.42.5(pid=22723): stderr: | [0;m[38;5;43m20221214123654603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123654603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123654604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123654604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123654605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123654605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123654605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:56.147716 run osmo-stp_10.42.42.5(pid=22723): stdout: | (launched: 2022-12-14_12:36:54.411105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:56.280098 run osmo-stp_10.42.42.5(pid=22723): stderr: | [0;m[38;5;43m20221214123654603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123654603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123654604 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123654604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123654605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123654605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123654605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:56.437605 run patchelf(pid=22726): Terminating (SIGINT) 12:36:56.619386 run patchelf(pid=22726): Terminated: ok {rc=0} 12:36:56.750224 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22723): Process ended prematurely: osmo-stp_10.42.42.5(pid=22723) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22723)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 12:36:56.760356 tst iperf3.py:8: Test FAILED (7.6 sec) 12:36:56.788873 run osmo-hlr_10.42.42.2(pid=22720): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22720)] 12:36:56.838780 run osmo-hlr_10.42.42.2(pid=22720): stdout: | (launched: 2022-12-14_12:36:53.397737) 12:36:56.890235 run osmo-hlr_10.42.42.2(pid=22720): stderr: | [0;m[1;31m20221214123653596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123653596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123653596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123653597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123653597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123653597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123653608 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123653616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123653616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123653616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:56.942071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22715): Terminating (SIGTERM) 12:36:56.983860 run iperf3-srv_10.42.42.10(pid=22716): Terminating (SIGTERM) 12:36:57.026462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22719): Terminating (SIGTERM) 12:36:57.068113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22722): Terminating (SIGTERM) 12:36:57.109840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22725): Terminating (SIGTERM) 12:36:57.152253 --- ParallelTerminationStrategy: PID 22715 died... 12:36:57.172726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22715): Terminated: ok {rc=0} 12:36:57.219323 --- ParallelTerminationStrategy: PID 22716 died... 12:36:57.239064 run iperf3-srv_10.42.42.10(pid=22716): Terminated {rc=256} 12:36:57.285245 --- ParallelTerminationStrategy: PID 22719 died... 12:36:57.304828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22719): Terminated: ok {rc=0} 12:36:57.350754 --- ParallelTerminationStrategy: PID 22722 died... 12:36:57.370354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22722): Terminated: ok {rc=0} 12:36:57.415989 --- ParallelTerminationStrategy: PID 22725 died... 12:36:57.435584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22725): Terminated: ok {rc=0} 12:36:57.523608 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:36:58.673416 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:58.685548 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:36:58.737171 tst iperf3m4.py: using LAC 40945 12:36:58.865365 tst iperf3m4.py: using RAC 145 12:36:58.992163 tst iperf3m4.py: using CellId 40945 12:36:59.121742 tst iperf3m4.py: using BVCI 40946 12:36:59.241142 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:59.252578 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:59.263855 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:59.275000 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:59.286623 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:59.298246 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:59.310172 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:59.321917 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:36:59.333720 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:36:59.455816 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:36:59.575256 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:36:59.693415 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:36:59.815458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:37:00.035007 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:00.363341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22727): Launched 12:37:00.647251 run iperf3-srv_10.42.42.10(pid=22728): Launched 12:37:00.769346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:37:00.991865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:01.314030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22729): Launched 12:37:01.601753 run iperf3-srv_10.42.42.10(pid=22730): Launched 12:37:01.730044 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:37:01.940620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:02.255034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22731): Launched 12:37:02.520759 run iperf3-srv_10.42.42.10(pid=22732): Launched 12:37:02.634153 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:37:02.834944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:03.138518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22733): Launched 12:37:03.402712 run iperf3-srv_10.42.42.10(pid=22734): Launched 12:37:03.515843 tst iperf3m4.py:8: start network... 12:37:03.717347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:04.185162 run create_hlr_db(pid=22735): Launched 12:37:04.299382 bus /gobi_6: Setting Powered False 12:37:05.359191 run create_hlr_db(pid=22735): Terminated: ok {rc=0} 12:37:05.801681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22737): Launched 12:37:06.125047 run osmo-hlr_10.42.42.2(pid=22738): Launched 12:37:06.247268 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:06.812466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22740): Launched 12:37:07.136630 run osmo-stp_10.42.42.5(pid=22741): Launched 12:37:07.259321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:07.818723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22743): Launched 12:37:07.941832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:08.215742 run patchelf(pid=22744): Launched 12:37:08.395465 run osmo-stp_10.42.42.5(pid=22741): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22741)] 12:37:08.532177 run osmo-stp_10.42.42.5(pid=22741): stdout: | (launched: 2022-12-14_12:37:07.076424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:08.670471 run osmo-stp_10.42.42.5(pid=22741): stderr: | [0;m[38;5;43m20221214123707266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123707266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123707266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123707267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123707267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123707267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123707267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:08.808387 run osmo-stp_10.42.42.5(pid=22741): stdout: | (launched: 2022-12-14_12:37:07.076424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:08.940644 run osmo-stp_10.42.42.5(pid=22741): stderr: | [0;m[38;5;43m20221214123707266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123707266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123707266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123707267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123707267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123707267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123707267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:09.097177 run patchelf(pid=22744): Terminating (SIGINT) 12:37:09.278037 run patchelf(pid=22744): Terminated: ok {rc=0} 12:37:09.408137 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22741): Process ended prematurely: osmo-stp_10.42.42.5(pid=22741) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22741)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 12:37:09.418402 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:37:09.447071 run osmo-hlr_10.42.42.2(pid=22738): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22738)] 12:37:09.496224 run osmo-hlr_10.42.42.2(pid=22738): stdout: | (launched: 2022-12-14_12:37:06.065403) 12:37:09.547690 run osmo-hlr_10.42.42.2(pid=22738): stderr: | [0;m[1;31m20221214123706260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123706260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123706260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123706260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123706260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123706260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123706273 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123706281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123706282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123706282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:09.599589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22727): Terminating (SIGTERM) 12:37:09.640717 run iperf3-srv_10.42.42.10(pid=22728): Terminating (SIGTERM) 12:37:09.682670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22729): Terminating (SIGTERM) 12:37:09.724042 run iperf3-srv_10.42.42.10(pid=22730): Terminating (SIGTERM) 12:37:09.765945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22731): Terminating (SIGTERM) 12:37:09.807157 run iperf3-srv_10.42.42.10(pid=22732): Terminating (SIGTERM) 12:37:09.848738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22733): Terminating (SIGTERM) 12:37:09.890064 run iperf3-srv_10.42.42.10(pid=22734): Terminating (SIGTERM) 12:37:09.931132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22737): Terminating (SIGTERM) 12:37:09.972722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22740): Terminating (SIGTERM) 12:37:10.014008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22743): Terminating (SIGTERM) 12:37:10.055916 --- ParallelTerminationStrategy: PID 22727 died... 12:37:10.075768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22727): Terminated: ok {rc=0} 12:37:10.121200 --- ParallelTerminationStrategy: PID 22728 died... 12:37:10.140512 run iperf3-srv_10.42.42.10(pid=22728): Terminated {rc=256} 12:37:10.185728 --- ParallelTerminationStrategy: PID 22729 died... 12:37:10.204877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22729): Terminated: ok {rc=0} 12:37:10.251099 --- ParallelTerminationStrategy: PID 22730 died... 12:37:10.270768 run iperf3-srv_10.42.42.10(pid=22730): Terminated {rc=256} 12:37:10.316211 --- ParallelTerminationStrategy: PID 22731 died... 12:37:10.335441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22731): Terminated: ok {rc=0} 12:37:10.380402 --- ParallelTerminationStrategy: PID 22732 died... 12:37:10.399649 run iperf3-srv_10.42.42.10(pid=22732): Terminated {rc=256} 12:37:10.444622 --- ParallelTerminationStrategy: PID 22733 died... 12:37:10.463893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22733): Terminated: ok {rc=0} 12:37:10.509550 --- ParallelTerminationStrategy: PID 22734 died... 12:37:10.528842 run iperf3-srv_10.42.42.10(pid=22734): Terminated {rc=256} 12:37:10.574044 --- ParallelTerminationStrategy: PID 22737 died... 12:37:10.593336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22737): Terminated: ok {rc=0} 12:37:10.638487 --- ParallelTerminationStrategy: PID 22740 died... 12:37:10.657849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22740): Terminated: ok {rc=0} 12:37:10.703345 --- ParallelTerminationStrategy: PID 22743 died... 12:37:10.722973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22743): Terminated: ok {rc=0} 12:37:10.810416 bus /gobi_4: Setting Powered False 12:37:11.908999 bus /gobi_4: Setting Powered False 12:37:13.023653 bus /gobi_1: Setting Powered False 12:37:14.122087 bus /gobi_1: Setting Powered False 12:37:15.237865 bus /gobi_0: Setting Powered False 12:37:16.334655 bus /gobi_0: Setting Powered False 12:37:17.452662 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 12:37:18.557372 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:18.569675 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:37:18.619988 tst ping.py: using LAC 40946 12:37:18.738794 tst ping.py: using RAC 146 12:37:18.857552 tst ping.py: using CellId 40946 12:37:18.983904 tst ping.py: using BVCI 40947 12:37:19.101614 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:19.113207 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:19.124811 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:19.136061 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:19.147752 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:19.159366 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:19.171318 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:19.183089 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:37:19.299178 tst ping.py:19: start network... 12:37:19.498011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:19.957305 run create_hlr_db(pid=22745): Launched 12:37:20.070451 bus /gobi_6: Setting Powered False 12:37:21.129129 run create_hlr_db(pid=22745): Terminated: ok {rc=0} 12:37:21.567404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22747): Launched 12:37:21.886035 run osmo-hlr_10.42.42.2(pid=22748): Launched 12:37:22.006582 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:22.562432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22750): Launched 12:37:22.881271 run osmo-stp_10.42.42.5(pid=22751): Launched 12:37:23.002142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:23.554227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22753): Launched 12:37:23.678671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:23.949029 run patchelf(pid=22754): Launched 12:37:24.126198 run osmo-stp_10.42.42.5(pid=22751): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22751)] 12:37:24.261503 run osmo-stp_10.42.42.5(pid=22751): stdout: | (launched: 2022-12-14_12:37:22.821982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:24.399404 run osmo-stp_10.42.42.5(pid=22751): stderr: | [0;m[38;5;43m20221214123723015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123723015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123723015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123723016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123723016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123723016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123723016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:24.537221 run osmo-stp_10.42.42.5(pid=22751): stdout: | (launched: 2022-12-14_12:37:22.821982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:24.667463 run osmo-stp_10.42.42.5(pid=22751): stderr: | [0;m[38;5;43m20221214123723015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123723015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123723015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123723016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123723016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123723016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123723016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:24.822303 run patchelf(pid=22754): Terminating (SIGINT) 12:37:25.001469 run patchelf(pid=22754): Terminated: ok {rc=0} 12:37:25.129976 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22751): Process ended prematurely: osmo-stp_10.42.42.5(pid=22751) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22751)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 12:37:25.139455 tst ping.py:22: Test FAILED (6.6 sec) 12:37:25.167459 run osmo-hlr_10.42.42.2(pid=22748): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22748)] 12:37:25.216899 run osmo-hlr_10.42.42.2(pid=22748): stdout: | (launched: 2022-12-14_12:37:21.826718) 12:37:25.267911 run osmo-hlr_10.42.42.2(pid=22748): stderr: | [0;m[1;31m20221214123722028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123722028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123722028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123722028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123722029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123722029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123722041 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123722049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123722049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123722049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:25.319324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22747): Terminating (SIGTERM) 12:37:25.360626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22750): Terminating (SIGTERM) 12:37:25.401881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22753): Terminating (SIGTERM) 12:37:25.443345 --- ParallelTerminationStrategy: PID 22747 died... 12:37:25.463204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22747): Terminated: ok {rc=0} 12:37:25.509148 --- ParallelTerminationStrategy: PID 22750 died... 12:37:25.528144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22750): Terminated: ok {rc=0} 12:37:25.573907 --- ParallelTerminationStrategy: PID 22753 died... 12:37:25.593412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22753): Terminated: ok {rc=0} 12:37:25.679266 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:37:26.766514 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:26.778686 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:37:26.829452 tst ping_idle_ping.py: using LAC 40947 12:37:26.947163 tst ping_idle_ping.py: using RAC 147 12:37:27.063347 tst ping_idle_ping.py: using CellId 40947 12:37:27.181172 tst ping_idle_ping.py: using BVCI 40948 12:37:27.288793 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:27.299914 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:27.310700 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:27.321516 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:27.333048 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:27.344471 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:27.356270 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:37:27.367757 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:37:27.485937 tst ping_idle_ping.py:24: start network... 12:37:27.686561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:28.150215 run create_hlr_db(pid=22755): Launched 12:37:28.263034 bus /gobi_6: Setting Powered False 12:37:29.327416 run create_hlr_db(pid=22755): Terminated: ok {rc=0} 12:37:29.775289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22757): Launched 12:37:30.095289 run osmo-hlr_10.42.42.2(pid=22758): Launched 12:37:30.216524 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:30.773286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22760): Launched 12:37:31.118628 run osmo-stp_10.42.42.5(pid=22761): Launched 12:37:31.385321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:32.026558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22763): Launched 12:37:32.157305 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:32.414493 run patchelf(pid=22764): Launched 12:37:32.581375 run osmo-stp_10.42.42.5(pid=22761): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22761)] 12:37:32.708093 run osmo-stp_10.42.42.5(pid=22761): stdout: | (launched: 2022-12-14_12:37:31.061237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:32.836901 run osmo-stp_10.42.42.5(pid=22761): stderr: | [0;m[38;5;43m20221214123731384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123731384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123731384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123731393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123731393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123731394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123731394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:32.965238 run osmo-stp_10.42.42.5(pid=22761): stdout: | (launched: 2022-12-14_12:37:31.061237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:33.086623 run osmo-stp_10.42.42.5(pid=22761): stderr: | [0;m[38;5;43m20221214123731384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123731384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123731384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123731393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123731393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123731394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123731394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:33.230498 run patchelf(pid=22764): Terminating (SIGINT) 12:37:33.397709 run patchelf(pid=22764): Terminated: ok {rc=0} 12:37:33.517848 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22761): Process ended prematurely: osmo-stp_10.42.42.5(pid=22761) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22761)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 12:37:33.526738 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:37:33.553215 run osmo-hlr_10.42.42.2(pid=22758): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22758)] 12:37:33.601124 run osmo-hlr_10.42.42.2(pid=22758): stdout: | (launched: 2022-12-14_12:37:30.035634) 12:37:33.650273 run osmo-hlr_10.42.42.2(pid=22758): stderr: | [0;m[1;31m20221214123730234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123730234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123730234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123730234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123730234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123730234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123730246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123730254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123730254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123730254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:33.699580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22757): Terminating (SIGTERM) 12:37:33.739316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22760): Terminating (SIGTERM) 12:37:33.778907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22763): Terminating (SIGTERM) 12:37:33.818929 --- ParallelTerminationStrategy: PID 22757 died... 12:37:33.838261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22757): Terminated: ok {rc=0} 12:37:33.882288 --- ParallelTerminationStrategy: PID 22760 died... 12:37:33.901371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22760): Terminated: ok {rc=0} 12:37:33.945666 --- ParallelTerminationStrategy: PID 22763 died... 12:37:33.964716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22763): Terminated: ok {rc=0} 12:37:34.051212 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:37:35.360526 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:35.368043 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:37:35.400844 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:37:35.441070 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:37:35.530206 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:37:35.563291 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:37:35.602738 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:37:36.199379 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:37:36.251238 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:36.262803 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:37:36.330642 tst cs_paging_gprs_active.py: using LAC 40948 12:37:36.457361 tst cs_paging_gprs_active.py: using RAC 148 12:37:36.583998 tst cs_paging_gprs_active.py: using CellId 40948 12:37:36.710371 tst cs_paging_gprs_active.py: using BVCI 40949 12:37:36.829666 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:36.841118 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:36.852248 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:36.863531 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:36.874738 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:36.885929 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:36.897240 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:36.908297 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:36.919659 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:37:37.036637 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:37:37.157791 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:37:37.376506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:37.703700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22768): Launched 12:37:37.988112 run iperf3-srv_10.42.42.10(pid=22769): Launched 12:37:38.109787 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:37:38.328122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:38.656221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22770): Launched 12:37:38.939515 run iperf3-srv_10.42.42.10(pid=22771): Launched 12:37:39.060928 tst cs_paging_gprs_active.py:38: start network... 12:37:39.279497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:39.782555 run create_hlr_db(pid=22772): Launched 12:37:39.912747 bus /gobi_6: Setting Powered False 12:37:40.973128 run create_hlr_db(pid=22772): Terminated: ok {rc=0} 12:37:41.395841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22774): Launched 12:37:41.699468 run osmo-hlr_10.42.42.2(pid=22775): Launched 12:37:41.815348 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:42.350508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22777): Launched 12:37:42.654355 run osmo-stp_10.42.42.5(pid=22778): Launched 12:37:42.769749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:43.292927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22780): Launched 12:37:43.409242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:43.666796 run patchelf(pid=22781): Launched 12:37:43.835101 run osmo-stp_10.42.42.5(pid=22778): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22778)] 12:37:43.963334 run osmo-stp_10.42.42.5(pid=22778): stdout: | (launched: 2022-12-14_12:37:42.597427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:44.093452 run osmo-stp_10.42.42.5(pid=22778): stderr: | [0;m[38;5;43m20221214123742768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123742768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123742768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123742769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123742769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123742769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123742769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:44.223923 run osmo-stp_10.42.42.5(pid=22778): stdout: | (launched: 2022-12-14_12:37:42.597427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:44.348424 run osmo-stp_10.42.42.5(pid=22778): stderr: | [0;m[38;5;43m20221214123742768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123742768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123742768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123742769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123742769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123742769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123742769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:44.495522 run patchelf(pid=22781): Terminating (SIGINT) 12:37:44.665872 run patchelf(pid=22781): Terminated: ok {rc=0} 12:37:44.788267 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22778): Process ended prematurely: osmo-stp_10.42.42.5(pid=22778) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22778)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:37:44.797800 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:37:44.824675 run osmo-hlr_10.42.42.2(pid=22775): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22775)] 12:37:44.872793 run osmo-hlr_10.42.42.2(pid=22775): stdout: | (launched: 2022-12-14_12:37:41.642574) 12:37:44.922585 run osmo-hlr_10.42.42.2(pid=22775): stderr: | [0;m[1;31m20221214123741819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123741819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123741819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123741819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123741819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123741819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123741831 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123741841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123741841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123741841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:44.971979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22768): Terminating (SIGTERM) 12:37:45.012133 run iperf3-srv_10.42.42.10(pid=22769): Terminating (SIGTERM) 12:37:45.052164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22770): Terminating (SIGTERM) 12:37:45.092569 run iperf3-srv_10.42.42.10(pid=22771): Terminating (SIGTERM) 12:37:45.132899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22774): Terminating (SIGTERM) 12:37:45.173321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22777): Terminating (SIGTERM) 12:37:45.213271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22780): Terminating (SIGTERM) 12:37:45.253399 --- ParallelTerminationStrategy: PID 22768 died... 12:37:45.272705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22768): Terminated: ok {rc=0} 12:37:45.316498 --- ParallelTerminationStrategy: PID 22769 died... 12:37:45.335126 run iperf3-srv_10.42.42.10(pid=22769): Terminated {rc=256} 12:37:45.378895 --- ParallelTerminationStrategy: PID 22770 died... 12:37:45.397592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22770): Terminated: ok {rc=0} 12:37:45.441613 --- ParallelTerminationStrategy: PID 22771 died... 12:37:45.460408 run iperf3-srv_10.42.42.10(pid=22771): Terminated {rc=256} 12:37:45.503864 --- ParallelTerminationStrategy: PID 22774 died... 12:37:45.522524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22774): Terminated: ok {rc=0} 12:37:45.566278 --- ParallelTerminationStrategy: PID 22777 died... 12:37:45.585176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22777): Terminated: ok {rc=0} 12:37:45.628731 --- ParallelTerminationStrategy: PID 22780 died... 12:37:45.647532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22780): Terminated: ok {rc=0} 12:37:45.730949 bus /gobi_0: Setting Powered False 12:37:46.827042 bus /gobi_0: Setting Powered False 12:37:47.960459 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:37:49.106636 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:49.118270 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:37:49.187435 tst iperf3.py: using LAC 40949 12:37:49.304766 tst iperf3.py: using RAC 149 12:37:49.422918 tst iperf3.py: using CellId 40949 12:37:49.545323 tst iperf3.py: using BVCI 40950 12:37:49.655229 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:49.666268 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:49.677135 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:49.687778 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:49.698822 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:49.709858 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:49.721003 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:49.731927 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:49.743045 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:37:49.858713 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:37:50.061771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:37:50.367953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22782): Launched 12:37:50.635234 run iperf3-srv_10.42.42.10(pid=22783): Launched 12:37:50.748891 tst iperf3.py:8: start network... 12:37:50.951935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:51.422913 run create_hlr_db(pid=22784): Launched 12:37:51.537715 bus /gobi_6: Setting Powered False 12:37:52.598636 run create_hlr_db(pid=22784): Terminated: ok {rc=0} 12:37:53.045328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22786): Launched 12:37:53.373891 run osmo-hlr_10.42.42.2(pid=22787): Launched 12:37:53.497976 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:54.063461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22789): Launched 12:37:54.389173 run osmo-stp_10.42.42.5(pid=22790): Launched 12:37:54.512743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:37:55.075328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22792): Launched 12:37:55.199513 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:37:55.474635 run patchelf(pid=22793): Launched 12:37:55.655369 run osmo-stp_10.42.42.5(pid=22790): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22790)] 12:37:55.792510 run osmo-stp_10.42.42.5(pid=22790): stdout: | (launched: 2022-12-14_12:37:54.328613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:55.931350 run osmo-stp_10.42.42.5(pid=22790): stderr: | [0;m[38;5;43m20221214123754523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123754524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123754524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123754524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123754525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123754525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123754525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:56.070107 run osmo-stp_10.42.42.5(pid=22790): stdout: | (launched: 2022-12-14_12:37:54.328613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:56.203047 run osmo-stp_10.42.42.5(pid=22790): stderr: | [0;m[38;5;43m20221214123754523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123754524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123754524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123754524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123754525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123754525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123754525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:56.360105 run patchelf(pid=22793): Terminating (SIGINT) 12:37:56.542730 run patchelf(pid=22793): Terminated: ok {rc=0} 12:37:56.674782 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22790): Process ended prematurely: osmo-stp_10.42.42.5(pid=22790) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22790)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 12:37:56.684894 tst iperf3.py:8: Test FAILED (7.6 sec) 12:37:56.713515 run osmo-hlr_10.42.42.2(pid=22787): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22787)] 12:37:56.763240 run osmo-hlr_10.42.42.2(pid=22787): stdout: | (launched: 2022-12-14_12:37:53.311590) 12:37:56.814645 run osmo-hlr_10.42.42.2(pid=22787): stderr: | [0;m[1;31m20221214123753512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123753513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123753514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123753514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123753514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123753514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123753529 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123753537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123753537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123753537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:56.866707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22782): Terminating (SIGTERM) 12:37:56.908354 run iperf3-srv_10.42.42.10(pid=22783): Terminating (SIGTERM) 12:37:56.950340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22786): Terminating (SIGTERM) 12:37:56.991944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22789): Terminating (SIGTERM) 12:37:57.033566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22792): Terminating (SIGTERM) 12:37:57.075702 --- ParallelTerminationStrategy: PID 22782 died... 12:37:57.095852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22782): Terminated: ok {rc=0} 12:37:57.142547 --- ParallelTerminationStrategy: PID 22783 died... 12:37:57.162227 run iperf3-srv_10.42.42.10(pid=22783): Terminated {rc=256} 12:37:57.207938 --- ParallelTerminationStrategy: PID 22786 died... 12:37:57.227498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22786): Terminated: ok {rc=0} 12:37:57.273351 --- ParallelTerminationStrategy: PID 22789 died... 12:37:57.292915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22789): Terminated: ok {rc=0} 12:37:57.338579 --- ParallelTerminationStrategy: PID 22792 died... 12:37:57.358121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22792): Terminated: ok {rc=0} 12:37:57.445466 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:37:58.595048 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:58.607303 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:37:58.689206 tst iperf3m4.py: using LAC 40950 12:37:58.820163 tst iperf3m4.py: using RAC 150 12:37:58.940870 tst iperf3m4.py: using CellId 40950 12:37:59.060823 tst iperf3m4.py: using BVCI 40951 12:37:59.171036 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:59.182250 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:59.193382 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:59.204267 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:59.215925 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:59.227153 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:59.238511 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:59.249699 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:37:59.261105 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:37:59.381733 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:37:59.503393 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:37:59.624155 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:37:59.742821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:37:59.946666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:00.253296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22794): Launched 12:38:00.520297 run iperf3-srv_10.42.42.10(pid=22795): Launched 12:38:00.634554 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:38:00.839394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:01.178958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22796): Launched 12:38:01.502392 run iperf3-srv_10.42.42.10(pid=22797): Launched 12:38:01.637342 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:38:01.862466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:02.210410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22798): Launched 12:38:02.476051 run iperf3-srv_10.42.42.10(pid=22799): Launched 12:38:02.590464 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:38:02.793849 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:03.099477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22800): Launched 12:38:03.365225 run iperf3-srv_10.42.42.10(pid=22801): Launched 12:38:03.479067 tst iperf3m4.py:8: start network... 12:38:03.682370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:04.151252 run create_hlr_db(pid=22802): Launched 12:38:04.265806 bus /gobi_6: Setting Powered False 12:38:05.325933 run create_hlr_db(pid=22802): Terminated: ok {rc=0} 12:38:05.770302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22804): Launched 12:38:06.096055 run osmo-hlr_10.42.42.2(pid=22805): Launched 12:38:06.219270 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:06.790153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22807): Launched 12:38:07.118106 run osmo-stp_10.42.42.5(pid=22808): Launched 12:38:07.240901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:38:07.804568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22810): Launched 12:38:07.928455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:38:08.204511 run patchelf(pid=22811): Launched 12:38:08.385141 run osmo-stp_10.42.42.5(pid=22808): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22808)] 12:38:08.522571 run osmo-stp_10.42.42.5(pid=22808): stdout: | (launched: 2022-12-14_12:38:07.056365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:08.662141 run osmo-stp_10.42.42.5(pid=22808): stderr: | [0;m[38;5;43m20221214123807247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123807247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123807247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123807248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123807248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123807248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123807248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:08.801850 run osmo-stp_10.42.42.5(pid=22808): stdout: | (launched: 2022-12-14_12:38:07.056365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:08.934733 run osmo-stp_10.42.42.5(pid=22808): stderr: | [0;m[38;5;43m20221214123807247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123807247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123807247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123807248 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123807248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123807248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123807248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:09.092134 run patchelf(pid=22811): Terminating (SIGINT) 12:38:09.274987 run patchelf(pid=22811): Terminated: ok {rc=0} 12:38:09.406423 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22808): Process ended prematurely: osmo-stp_10.42.42.5(pid=22808) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22808)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:38:09.416690 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:38:09.445561 run osmo-hlr_10.42.42.2(pid=22805): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22805)] 12:38:09.495635 run osmo-hlr_10.42.42.2(pid=22805): stdout: | (launched: 2022-12-14_12:38:06.035750) 12:38:09.547712 run osmo-hlr_10.42.42.2(pid=22805): stderr: | [0;m[1;31m20221214123806233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123806233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123806233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123806233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123806233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123806233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123806246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123806254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123806254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123806254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:09.600085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22794): Terminating (SIGTERM) 12:38:09.642337 run iperf3-srv_10.42.42.10(pid=22795): Terminating (SIGTERM) 12:38:09.684360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22796): Terminating (SIGTERM) 12:38:09.726761 run iperf3-srv_10.42.42.10(pid=22797): Terminating (SIGTERM) 12:38:09.768773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22798): Terminating (SIGTERM) 12:38:09.811041 run iperf3-srv_10.42.42.10(pid=22799): Terminating (SIGTERM) 12:38:09.853273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22800): Terminating (SIGTERM) 12:38:09.895400 run iperf3-srv_10.42.42.10(pid=22801): Terminating (SIGTERM) 12:38:09.937520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22804): Terminating (SIGTERM) 12:38:09.979663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22807): Terminating (SIGTERM) 12:38:10.021914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22810): Terminating (SIGTERM) 12:38:10.064545 --- ParallelTerminationStrategy: PID 22794 died... 12:38:10.084888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22794): Terminated: ok {rc=0} 12:38:10.131479 --- ParallelTerminationStrategy: PID 22795 died... 12:38:10.151306 run iperf3-srv_10.42.42.10(pid=22795): Terminated {rc=256} 12:38:10.197416 --- ParallelTerminationStrategy: PID 22796 died... 12:38:10.217199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22796): Terminated: ok {rc=0} 12:38:10.263601 --- ParallelTerminationStrategy: PID 22797 died... 12:38:10.283527 run iperf3-srv_10.42.42.10(pid=22797): Terminated {rc=256} 12:38:10.329874 --- ParallelTerminationStrategy: PID 22798 died... 12:38:10.349668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22798): Terminated: ok {rc=0} 12:38:10.395923 --- ParallelTerminationStrategy: PID 22799 died... 12:38:10.415779 run iperf3-srv_10.42.42.10(pid=22799): Terminated {rc=256} 12:38:10.462034 --- ParallelTerminationStrategy: PID 22800 died... 12:38:10.481991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22800): Terminated: ok {rc=0} 12:38:10.528640 --- ParallelTerminationStrategy: PID 22801 died... 12:38:10.548491 run iperf3-srv_10.42.42.10(pid=22801): Terminated {rc=256} 12:38:10.594737 --- ParallelTerminationStrategy: PID 22804 died... 12:38:10.614591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22804): Terminated: ok {rc=0} 12:38:10.660899 --- ParallelTerminationStrategy: PID 22807 died... 12:38:10.680696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22807): Terminated: ok {rc=0} 12:38:10.727516 --- ParallelTerminationStrategy: PID 22810 died... 12:38:10.747466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22810): Terminated: ok {rc=0} 12:38:10.835667 bus /gobi_4: Setting Powered False 12:38:11.934540 bus /gobi_4: Setting Powered False 12:38:13.052379 bus /gobi_1: Setting Powered False 12:38:14.151701 bus /gobi_1: Setting Powered False 12:38:15.268329 bus /gobi_0: Setting Powered False 12:38:16.385631 bus /gobi_0: Setting Powered False 12:38:17.512089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:38:18.612728 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:18.624384 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:38:18.691880 tst ping.py: using LAC 40951 12:38:18.818119 tst ping.py: using RAC 151 12:38:18.938551 tst ping.py: using CellId 40951 12:38:19.052917 tst ping.py: using BVCI 40952 12:38:19.159961 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:19.171016 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:19.181952 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:19.192640 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:19.203691 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:19.214817 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:19.225944 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:19.236905 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:38:19.351500 tst ping.py:19: start network... 12:38:19.550547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:20.010212 run create_hlr_db(pid=22812): Launched 12:38:20.122830 bus /gobi_6: Setting Powered False 12:38:21.182151 run create_hlr_db(pid=22812): Terminated: ok {rc=0} 12:38:21.621508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22814): Launched 12:38:21.942161 run osmo-hlr_10.42.42.2(pid=22815): Launched 12:38:22.065839 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:22.619640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22817): Launched 12:38:22.939629 run osmo-stp_10.42.42.5(pid=22818): Launched 12:38:23.060533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:38:23.613220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22820): Launched 12:38:23.734991 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:38:24.005775 run patchelf(pid=22821): Launched 12:38:24.172365 run osmo-stp_10.42.42.5(pid=22818): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22818)] 12:38:24.298908 run osmo-stp_10.42.42.5(pid=22818): stdout: | (launched: 2022-12-14_12:38:22.879944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:24.427190 run osmo-stp_10.42.42.5(pid=22818): stderr: | [0;m[38;5;43m20221214123823073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123823074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123823074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123823074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123823075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123823075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123823075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:24.555869 run osmo-stp_10.42.42.5(pid=22818): stdout: | (launched: 2022-12-14_12:38:22.879944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:24.677862 run osmo-stp_10.42.42.5(pid=22818): stderr: | [0;m[38;5;43m20221214123823073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123823074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123823074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123823074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123823075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123823075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123823075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:24.822872 run patchelf(pid=22821): Terminating (SIGINT) 12:38:24.990733 run patchelf(pid=22821): Terminated: ok {rc=0} 12:38:25.111622 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22818): Process ended prematurely: osmo-stp_10.42.42.5(pid=22818) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22818)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 12:38:25.120530 tst ping.py:22: Test FAILED (6.5 sec) 12:38:25.147353 run osmo-hlr_10.42.42.2(pid=22815): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22815)] 12:38:25.195495 run osmo-hlr_10.42.42.2(pid=22815): stdout: | (launched: 2022-12-14_12:38:21.882745) 12:38:25.245258 run osmo-hlr_10.42.42.2(pid=22815): stderr: | [0;m[1;31m20221214123822080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123822080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123822080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123822080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123822080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123822080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123822093 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123822101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123822102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123822102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:25.294852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22814): Terminating (SIGTERM) 12:38:25.335014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22817): Terminating (SIGTERM) 12:38:25.375184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22820): Terminating (SIGTERM) 12:38:25.415484 --- ParallelTerminationStrategy: PID 22814 died... 12:38:25.435009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22814): Terminated: ok {rc=0} 12:38:25.479519 --- ParallelTerminationStrategy: PID 22817 died... 12:38:25.498613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22817): Terminated: ok {rc=0} 12:38:25.542936 --- ParallelTerminationStrategy: PID 22820 died... 12:38:25.562000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22820): Terminated: ok {rc=0} 12:38:25.648209 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:38:26.739132 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:26.751779 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:38:26.823854 tst ping_idle_ping.py: using LAC 40952 12:38:26.949870 tst ping_idle_ping.py: using RAC 152 12:38:27.081651 tst ping_idle_ping.py: using CellId 40952 12:38:27.207654 tst ping_idle_ping.py: using BVCI 40953 12:38:27.323823 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:27.335329 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:27.346892 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:27.358230 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:27.369951 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:27.381795 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:27.393739 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:38:27.405663 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:38:27.526191 tst ping_idle_ping.py:24: start network... 12:38:27.743225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:28.242694 run create_hlr_db(pid=22823): Launched 12:38:28.372720 bus /gobi_6: Setting Powered False 12:38:29.435405 run create_hlr_db(pid=22823): Terminated: ok {rc=0} 12:38:29.884188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22825): Launched 12:38:30.205693 run osmo-hlr_10.42.42.2(pid=22826): Launched 12:38:30.327841 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:30.889642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22828): Launched 12:38:31.235604 run osmo-stp_10.42.42.5(pid=22829): Launched 12:38:31.458977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:38:32.086596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22831): Launched 12:38:32.220641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:38:32.494536 run patchelf(pid=22832): Launched 12:38:32.672802 run osmo-stp_10.42.42.5(pid=22829): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22829)] 12:38:32.807939 run osmo-stp_10.42.42.5(pid=22829): stdout: | (launched: 2022-12-14_12:38:31.173810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:32.945318 run osmo-stp_10.42.42.5(pid=22829): stderr: | [0;m[38;5;43m20221214123831409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123831409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123831410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123831410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123831411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123831411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123831411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:33.082675 run osmo-stp_10.42.42.5(pid=22829): stdout: | (launched: 2022-12-14_12:38:31.173810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:33.213385 run osmo-stp_10.42.42.5(pid=22829): stderr: | [0;m[38;5;43m20221214123831409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123831409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123831410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123831410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123831411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123831411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123831411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:33.367667 run patchelf(pid=22832): Terminating (SIGINT) 12:38:33.547320 run patchelf(pid=22832): Terminated: ok {rc=0} 12:38:33.676285 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22829): Process ended prematurely: osmo-stp_10.42.42.5(pid=22829) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22829)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:38:33.686047 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 12:38:33.714077 run osmo-hlr_10.42.42.2(pid=22826): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22826)] 12:38:33.763369 run osmo-hlr_10.42.42.2(pid=22826): stdout: | (launched: 2022-12-14_12:38:30.145901) 12:38:33.814789 run osmo-hlr_10.42.42.2(pid=22826): stderr: | [0;m[1;31m20221214123830345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123830345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123830345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123830346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123830346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123830346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123830363 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123830371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123830371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123830371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:33.866729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22825): Terminating (SIGTERM) 12:38:33.908355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22828): Terminating (SIGTERM) 12:38:33.950726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22831): Terminating (SIGTERM) 12:38:33.992574 --- ParallelTerminationStrategy: PID 22825 died... 12:38:34.012602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22825): Terminated: ok {rc=0} 12:38:34.058610 --- ParallelTerminationStrategy: PID 22828 died... 12:38:34.078245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22828): Terminated: ok {rc=0} 12:38:34.124350 --- ParallelTerminationStrategy: PID 22831 died... 12:38:34.143901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22831): Terminated: ok {rc=0} 12:38:34.231179 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:38:35.543524 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:35.551236 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:38:35.583716 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 12:38:35.622948 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 12:38:35.711784 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:38:35.744350 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 12:38:35.783266 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 12:38:36.386046 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 12:38:36.438453 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:36.449840 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:38:36.498835 tst cs_paging_gprs_active.py: using LAC 40953 12:38:36.625375 tst cs_paging_gprs_active.py: using RAC 153 12:38:36.751041 tst cs_paging_gprs_active.py: using CellId 40953 12:38:36.877869 tst cs_paging_gprs_active.py: using BVCI 40954 12:38:36.995975 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:37.007780 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:37.019403 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:37.030942 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:37.042995 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:37.054927 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:37.067272 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:37.079227 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:37.091476 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:38:37.209775 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:38:37.326448 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:38:37.543253 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:37.865907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22837): Launched 12:38:38.146030 run iperf3-srv_10.42.42.10(pid=22838): Launched 12:38:38.266304 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:38:38.481872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:38.805881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22839): Launched 12:38:39.087149 run iperf3-srv_10.42.42.10(pid=22840): Launched 12:38:39.206990 tst cs_paging_gprs_active.py:38: start network... 12:38:39.422919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:39.922239 run create_hlr_db(pid=22841): Launched 12:38:40.052693 bus /gobi_6: Setting Powered False 12:38:41.116563 run create_hlr_db(pid=22841): Terminated: ok {rc=0} 12:38:41.565999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22843): Launched 12:38:41.888041 run osmo-hlr_10.42.42.2(pid=22844): Launched 12:38:42.010239 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:42.566593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22846): Launched 12:38:42.889430 run osmo-stp_10.42.42.5(pid=22847): Launched 12:38:43.012458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:38:43.569752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22849): Launched 12:38:43.692730 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:38:43.964728 run patchelf(pid=22850): Launched 12:38:44.142943 run osmo-stp_10.42.42.5(pid=22847): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22847)] 12:38:44.278825 run osmo-stp_10.42.42.5(pid=22847): stdout: | (launched: 2022-12-14_12:38:42.829845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:44.416721 run osmo-stp_10.42.42.5(pid=22847): stderr: | [0;m[38;5;43m20221214123843024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123843024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123843024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123843025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123843025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123843025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123843026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:44.555510 run osmo-stp_10.42.42.5(pid=22847): stdout: | (launched: 2022-12-14_12:38:42.829845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:44.687292 run osmo-stp_10.42.42.5(pid=22847): stderr: | [0;m[38;5;43m20221214123843024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123843024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123843024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123843025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123843025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123843025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123843026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:44.843324 run patchelf(pid=22850): Terminating (SIGINT) 12:38:45.024097 run patchelf(pid=22850): Terminated: ok {rc=0} 12:38:45.154278 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22847): Process ended prematurely: osmo-stp_10.42.42.5(pid=22847) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22847)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 12:38:45.164464 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:38:45.192531 run osmo-hlr_10.42.42.2(pid=22844): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22844)] 12:38:45.242025 run osmo-hlr_10.42.42.2(pid=22844): stdout: | (launched: 2022-12-14_12:38:41.828248) 12:38:45.293296 run osmo-hlr_10.42.42.2(pid=22844): stderr: | [0;m[1;31m20221214123842029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123842029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123842029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123842029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123842029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123842029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123842042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123842050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123842050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123842050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:45.344797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22837): Terminating (SIGTERM) 12:38:45.386243 run iperf3-srv_10.42.42.10(pid=22838): Terminating (SIGTERM) 12:38:45.428234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22839): Terminating (SIGTERM) 12:38:45.469789 run iperf3-srv_10.42.42.10(pid=22840): Terminating (SIGTERM) 12:38:45.511113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22843): Terminating (SIGTERM) 12:38:45.553659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22846): Terminating (SIGTERM) 12:38:45.595280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22849): Terminating (SIGTERM) 12:38:45.637387 --- ParallelTerminationStrategy: PID 22837 died... 12:38:45.657263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22837): Terminated: ok {rc=0} 12:38:45.702879 --- ParallelTerminationStrategy: PID 22838 died... 12:38:45.722217 run iperf3-srv_10.42.42.10(pid=22838): Terminated {rc=256} 12:38:45.767545 --- ParallelTerminationStrategy: PID 22839 died... 12:38:45.786882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22839): Terminated: ok {rc=0} 12:38:45.832433 --- ParallelTerminationStrategy: PID 22840 died... 12:38:45.852303 run iperf3-srv_10.42.42.10(pid=22840): Terminated {rc=256} 12:38:45.898598 --- ParallelTerminationStrategy: PID 22843 died... 12:38:45.918353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22843): Terminated: ok {rc=0} 12:38:45.964575 --- ParallelTerminationStrategy: PID 22846 died... 12:38:45.984657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22846): Terminated: ok {rc=0} 12:38:46.030891 --- ParallelTerminationStrategy: PID 22849 died... 12:38:46.051044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22849): Terminated: ok {rc=0} 12:38:46.144994 bus /gobi_0: Setting Powered False 12:38:47.256451 bus /gobi_0: Setting Powered False 12:38:48.372407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 12:38:49.520439 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:49.532928 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:38:49.584308 tst iperf3.py: using LAC 40954 12:38:49.712836 tst iperf3.py: using RAC 154 12:38:49.841826 tst iperf3.py: using CellId 40954 12:38:49.967368 tst iperf3.py: using BVCI 40955 12:38:50.083628 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:50.095710 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:50.107521 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:50.119079 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:50.130762 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:50.142345 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:50.154075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:50.165614 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:50.177466 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:38:50.296167 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:38:50.496930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:38:50.798019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22852): Launched 12:38:51.059776 run iperf3-srv_10.42.42.10(pid=22853): Launched 12:38:51.171746 tst iperf3.py:8: start network... 12:38:51.370619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:51.834906 run create_hlr_db(pid=22854): Launched 12:38:51.949181 bus /gobi_6: Setting Powered False 12:38:53.009073 run create_hlr_db(pid=22854): Terminated: ok {rc=0} 12:38:53.448832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22856): Launched 12:38:53.770139 run osmo-hlr_10.42.42.2(pid=22857): Launched 12:38:53.891938 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:54.453681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22859): Launched 12:38:54.775706 run osmo-stp_10.42.42.5(pid=22860): Launched 12:38:54.897816 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:38:55.453147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22863): Launched 12:38:55.575981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:38:55.849216 run patchelf(pid=22864): Launched 12:38:56.027260 run osmo-stp_10.42.42.5(pid=22860): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22860)] 12:38:56.163918 run osmo-stp_10.42.42.5(pid=22860): stdout: | (launched: 2022-12-14_12:38:54.715992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:56.301913 run osmo-stp_10.42.42.5(pid=22860): stderr: | [0;m[38;5;43m20221214123854907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123854907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123854907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123854908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123854908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123854908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123854908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:56.439825 run osmo-stp_10.42.42.5(pid=22860): stdout: | (launched: 2022-12-14_12:38:54.715992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:56.572314 run osmo-stp_10.42.42.5(pid=22860): stderr: | [0;m[38;5;43m20221214123854907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123854907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123854907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123854908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123854908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123854908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123854908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:56.728748 run patchelf(pid=22864): Terminating (SIGINT) 12:38:56.909183 run patchelf(pid=22864): Terminated: ok {rc=0} 12:38:57.039153 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22860): Process ended prematurely: osmo-stp_10.42.42.5(pid=22860) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22860)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 12:38:57.049358 tst iperf3.py:8: Test FAILED (7.6 sec) 12:38:57.077896 run osmo-hlr_10.42.42.2(pid=22857): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22857)] 12:38:57.128285 run osmo-hlr_10.42.42.2(pid=22857): stdout: | (launched: 2022-12-14_12:38:53.710842) 12:38:57.179989 run osmo-hlr_10.42.42.2(pid=22857): stderr: | [0;m[1;31m20221214123853907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123853907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123853907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123853908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123853908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123853908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123853920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123853929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123853929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123853929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:57.232097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22852): Terminating (SIGTERM) 12:38:57.273570 run iperf3-srv_10.42.42.10(pid=22853): Terminating (SIGTERM) 12:38:57.315427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22856): Terminating (SIGTERM) 12:38:57.357123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22859): Terminating (SIGTERM) 12:38:57.399017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22863): Terminating (SIGTERM) 12:38:57.440681 --- ParallelTerminationStrategy: PID 22852 died... 12:38:57.460640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22852): Terminated: ok {rc=0} 12:38:57.506219 --- ParallelTerminationStrategy: PID 22853 died... 12:38:57.525342 run iperf3-srv_10.42.42.10(pid=22853): Terminated {rc=256} 12:38:57.571245 --- ParallelTerminationStrategy: PID 22856 died... 12:38:57.590766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22856): Terminated: ok {rc=0} 12:38:57.636445 --- ParallelTerminationStrategy: PID 22859 died... 12:38:57.655804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22859): Terminated: ok {rc=0} 12:38:57.701570 --- ParallelTerminationStrategy: PID 22863 died... 12:38:57.720831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22863): Terminated: ok {rc=0} 12:38:57.807086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 12:38:58.953513 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:58.965485 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:38:59.016549 tst iperf3m4.py: using LAC 40955 12:38:59.137608 tst iperf3m4.py: using RAC 155 12:38:59.254504 tst iperf3m4.py: using CellId 40955 12:38:59.370519 tst iperf3m4.py: using BVCI 40956 12:38:59.481212 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:59.492568 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:59.504080 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:59.515430 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:59.526855 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:59.538550 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:59.550261 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:59.561946 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:38:59.573888 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:38:59.695624 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:38:59.813665 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:38:59.930699 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:39:00.047062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:39:00.249903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:39:00.552713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22865): Launched 12:39:00.816203 run iperf3-srv_10.42.42.10(pid=22866): Launched 12:39:00.968149 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:39:01.176832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:39:01.497790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22867): Launched 12:39:01.890879 run iperf3-srv_10.42.42.10(pid=22880): Launched 12:39:02.097975 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:39:02.370361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:39:02.755125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22917): Launched 12:39:03.070476 run iperf3-srv_10.42.42.10(pid=22930): Launched 12:39:03.235280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:39:03.499832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:39:03.906144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23031): Launched 12:39:04.268566 run iperf3-srv_10.42.42.10(pid=23076): Launched 12:39:04.454946 tst iperf3m4.py:8: start network... 12:39:04.706777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:05.240745 run create_hlr_db(pid=23143): Launched 12:39:05.390745 bus /gobi_6: Setting Powered False 12:39:06.451893 run create_hlr_db(pid=23143): Terminated: ok {rc=0} 12:39:06.890311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23146): Launched 12:39:07.230406 run osmo-hlr_10.42.42.2(pid=23148): Launched 12:39:07.471332 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:08.165995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23150): Launched 12:39:08.491523 run osmo-stp_10.42.42.5(pid=23151): Launched 12:39:08.745932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:09.379098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23153): Launched 12:39:09.515035 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:09.796476 run patchelf(pid=23154): Launched 12:39:09.993816 run osmo-stp_10.42.42.5(pid=23151): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23151)] 12:39:10.134800 run osmo-stp_10.42.42.5(pid=23151): stdout: | (launched: 2022-12-14_12:39:08.431674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:10.278289 run osmo-stp_10.42.42.5(pid=23151): stderr: | [0;m[38;5;43m20221214123908717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123908717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123908717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123908718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123908718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123908718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123908718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:10.420621 run osmo-stp_10.42.42.5(pid=23151): stdout: | (launched: 2022-12-14_12:39:08.431674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:10.557114 run osmo-stp_10.42.42.5(pid=23151): stderr: | [0;m[38;5;43m20221214123908717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123908717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123908717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123908718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123908718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123908718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123908718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:10.718683 run patchelf(pid=23154): Terminating (SIGINT) 12:39:10.904267 run patchelf(pid=23154): Terminated: ok {rc=0} 12:39:11.039003 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23151): Process ended prematurely: osmo-stp_10.42.42.5(pid=23151) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23151)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 12:39:11.050735 tst iperf3m4.py:8: Test FAILED (12.1 sec) 12:39:11.081371 run osmo-hlr_10.42.42.2(pid=23148): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23148)] 12:39:11.133508 run osmo-hlr_10.42.42.2(pid=23148): stdout: | (launched: 2022-12-14_12:39:07.167839) 12:39:11.187247 run osmo-hlr_10.42.42.2(pid=23148): stderr: | [0;m[1;31m20221214123907495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123907495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123907495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123907495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123907495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123907495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123907511 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123907523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123907524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123907524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:11.241921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22865): Terminating (SIGTERM) 12:39:11.285771 run iperf3-srv_10.42.42.10(pid=22866): Terminating (SIGTERM) 12:39:11.332787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22867): Terminating (SIGTERM) 12:39:11.377229 run iperf3-srv_10.42.42.10(pid=22880): Terminating (SIGTERM) 12:39:11.423422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22917): Terminating (SIGTERM) 12:39:11.467493 run iperf3-srv_10.42.42.10(pid=22930): Terminating (SIGTERM) 12:39:11.513829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23031): Terminating (SIGTERM) 12:39:11.558425 run iperf3-srv_10.42.42.10(pid=23076): Terminating (SIGTERM) 12:39:11.605284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23146): Terminating (SIGTERM) 12:39:11.649624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23150): Terminating (SIGTERM) 12:39:11.695001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23153): Terminating (SIGTERM) 12:39:11.741186 --- ParallelTerminationStrategy: PID 22865 died... 12:39:11.762510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22865): Terminated: ok {rc=0} 12:39:11.811587 --- ParallelTerminationStrategy: PID 22866 died... 12:39:11.832833 run iperf3-srv_10.42.42.10(pid=22866): Terminated {rc=256} 12:39:11.880745 --- ParallelTerminationStrategy: PID 22867 died... 12:39:11.916797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22867): Terminated: ok {rc=0} 12:39:11.993934 --- ParallelTerminationStrategy: PID 22880 died... 12:39:12.018475 run iperf3-srv_10.42.42.10(pid=22880): Terminated {rc=256} 12:39:12.065871 --- ParallelTerminationStrategy: PID 22917 died... 12:39:12.086339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22917): Terminated: ok {rc=0} 12:39:12.133332 --- ParallelTerminationStrategy: PID 22930 died... 12:39:12.153908 run iperf3-srv_10.42.42.10(pid=22930): Terminated {rc=256} 12:39:12.201328 --- ParallelTerminationStrategy: PID 23031 died... 12:39:12.221691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23031): Terminated: ok {rc=0} 12:39:12.268927 --- ParallelTerminationStrategy: PID 23076 died... 12:39:12.289420 run iperf3-srv_10.42.42.10(pid=23076): Terminated {rc=256} 12:39:12.336862 --- ParallelTerminationStrategy: PID 23146 died... 12:39:12.357412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23146): Terminated: ok {rc=0} 12:39:12.404793 --- ParallelTerminationStrategy: PID 23150 died... 12:39:12.425429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23150): Terminated: ok {rc=0} 12:39:12.473286 --- ParallelTerminationStrategy: PID 23153 died... 12:39:12.493953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23153): Terminated: ok {rc=0} 12:39:12.588379 bus /gobi_4: Setting Powered False 12:39:13.692669 bus /gobi_4: Setting Powered False 12:39:14.815269 bus /gobi_1: Setting Powered False 12:39:15.934215 bus /gobi_1: Setting Powered False 12:39:17.106133 bus /gobi_0: Setting Powered False 12:39:18.229415 bus /gobi_0: Setting Powered False 12:39:19.352406 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 12:39:20.461096 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:20.474993 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:39:20.530729 tst ping.py: using LAC 40956 12:39:20.657630 tst ping.py: using RAC 156 12:39:20.784688 tst ping.py: using CellId 40956 12:39:20.910993 tst ping.py: using BVCI 40957 12:39:21.030783 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:21.043953 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:21.057831 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:21.070783 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:21.083624 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:21.096901 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:21.110019 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:21.123071 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:39:21.247381 tst ping.py:19: start network... 12:39:21.469889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:21.978750 run create_hlr_db(pid=23155): Launched 12:39:22.146540 bus /gobi_6: Setting Powered False 12:39:23.210527 run create_hlr_db(pid=23155): Terminated: ok {rc=0} 12:39:23.672592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23157): Launched 12:39:24.011714 run osmo-hlr_10.42.42.2(pid=23158): Launched 12:39:24.255627 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:24.875771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23160): Launched 12:39:25.171653 run osmo-stp_10.42.42.5(pid=23161): Launched 12:39:25.284728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:25.794378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23163): Launched 12:39:25.909147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:26.159163 run patchelf(pid=23164): Launched 12:39:26.324865 run osmo-stp_10.42.42.5(pid=23161): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23161)] 12:39:26.450879 run osmo-stp_10.42.42.5(pid=23161): stdout: | (launched: 2022-12-14_12:39:25.116554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:26.578686 run osmo-stp_10.42.42.5(pid=23161): stderr: | [0;m[38;5;43m20221214123925288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123925288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123925288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123925289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123925289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123925289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123925289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:26.706694 run osmo-stp_10.42.42.5(pid=23161): stdout: | (launched: 2022-12-14_12:39:25.116554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:26.827858 run osmo-stp_10.42.42.5(pid=23161): stderr: | [0;m[38;5;43m20221214123925288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123925288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123925288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123925289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123925289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123925289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123925289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:26.971534 run patchelf(pid=23164): Terminating (SIGINT) 12:39:27.138107 run patchelf(pid=23164): Terminated: ok {rc=0} 12:39:27.258607 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23161): Process ended prematurely: osmo-stp_10.42.42.5(pid=23161) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23161)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 12:39:27.267564 tst ping.py:22: Test FAILED (6.8 sec) 12:39:27.294181 run osmo-hlr_10.42.42.2(pid=23158): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23158)] 12:39:27.342698 run osmo-hlr_10.42.42.2(pid=23158): stdout: | (launched: 2022-12-14_12:39:23.951849) 12:39:27.392088 run osmo-hlr_10.42.42.2(pid=23158): stderr: | [0;m[1;31m20221214123924261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123924261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123924261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123924261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123924262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123924262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123924283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123924295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123924295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123924295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:27.442190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23157): Terminating (SIGTERM) 12:39:27.482266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23160): Terminating (SIGTERM) 12:39:27.522191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23163): Terminating (SIGTERM) 12:39:27.562303 --- ParallelTerminationStrategy: PID 23157 died... 12:39:27.581892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23157): Terminated: ok {rc=0} 12:39:27.626210 --- ParallelTerminationStrategy: PID 23160 died... 12:39:27.645231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23160): Terminated: ok {rc=0} 12:39:27.689390 --- ParallelTerminationStrategy: PID 23163 died... 12:39:27.708468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23163): Terminated: ok {rc=0} 12:39:27.794818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 12:39:28.881837 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:28.894104 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:39:28.945454 tst ping_idle_ping.py: using LAC 40957 12:39:29.064080 tst ping_idle_ping.py: using RAC 157 12:39:29.181839 tst ping_idle_ping.py: using CellId 40957 12:39:29.297307 tst ping_idle_ping.py: using BVCI 40958 12:39:29.404745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:29.416335 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:29.427645 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:29.439029 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:29.450718 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:29.462296 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:29.473996 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:39:29.485871 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:39:29.601879 tst ping_idle_ping.py:24: start network... 12:39:29.818802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:30.316534 run create_hlr_db(pid=23165): Launched 12:39:30.446570 bus /gobi_6: Setting Powered False 12:39:31.508025 run create_hlr_db(pid=23165): Terminated: ok {rc=0} 12:39:31.967682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23167): Launched 12:39:32.304327 run osmo-hlr_10.42.42.2(pid=23168): Launched 12:39:32.428670 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:32.981918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23170): Launched 12:39:33.299729 run osmo-stp_10.42.42.5(pid=23171): Launched 12:39:33.422105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:33.971143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23173): Launched 12:39:34.093772 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:34.362651 run patchelf(pid=23174): Launched 12:39:34.540567 run osmo-stp_10.42.42.5(pid=23171): ERR: Terminated: ERROR {rc=1} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23171)] 12:39:34.675492 run osmo-stp_10.42.42.5(pid=23171): stdout: | (launched: 2022-12-14_12:39:33.240929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:34.811611 run osmo-stp_10.42.42.5(pid=23171): stderr: | [0;m[38;5;43m20221214123933435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123933435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123933435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123933436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123933438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123933438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123933438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:34.947796 run osmo-stp_10.42.42.5(pid=23171): stdout: | (launched: 2022-12-14_12:39:33.240929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:35.077433 run osmo-stp_10.42.42.5(pid=23171): stderr: | [0;m[38;5;43m20221214123933435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123933435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123933435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123933436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123933438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123933438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123933438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:35.230981 run patchelf(pid=23174): Terminating (SIGINT) 12:39:35.409735 run patchelf(pid=23174): Terminated: ok {rc=0} 12:39:35.537911 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23171): Process ended prematurely: osmo-stp_10.42.42.5(pid=23171) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23171)] [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 12:39:35.547835 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:39:35.576114 run osmo-hlr_10.42.42.2(pid=23168): ERR: Terminated: ERROR {rc=237} [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23168)] 12:39:35.626218 run osmo-hlr_10.42.42.2(pid=23168): stdout: | (launched: 2022-12-14_12:39:32.245154) 12:39:35.677869 run osmo-hlr_10.42.42.2(pid=23168): stderr: | [0;m[1;31m20221214123932446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123932446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123932446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123932446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123932446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123932446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123932459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123932467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123932468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123932468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:35.731171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23167): Terminating (SIGTERM) 12:39:35.772847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23170): Terminating (SIGTERM) 12:39:35.814586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23173): Terminating (SIGTERM) 12:39:35.856462 --- ParallelTerminationStrategy: PID 23167 died... 12:39:35.876576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23167): Terminated: ok {rc=0} 12:39:35.922716 --- ParallelTerminationStrategy: PID 23170 died... 12:39:35.942169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23170): Terminated: ok {rc=0} 12:39:35.987993 --- ParallelTerminationStrategy: PID 23173 died... 12:39:36.007514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23173): Terminated: ok {rc=0} 12:39:36.095343 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 12:39:37.418016 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:39:37.426226 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:39:37.459069 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:39:37.494721 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:39:37.551485 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:39:37.584159 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:39:37.618165 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:39:38.180386 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2404 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:39:38.186761 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:38.200262 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:39:38.269438 tst switch_tch_pdch.py: using LAC 40958 12:39:38.387266 tst switch_tch_pdch.py: using RAC 158 12:39:38.505384 tst switch_tch_pdch.py: using CellId 40958 12:39:38.622983 tst switch_tch_pdch.py: using BVCI 40959 12:39:38.730395 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:38.742072 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:38.753454 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:38.764679 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:38.776809 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:38.788858 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:38.801234 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:39:38.813676 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:39:38.935657 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:39:39.053571 tst switch_tch_pdch.py:51: start network... 12:39:39.252188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:39.710042 run create_hlr_db(pid=23180): Launched 12:39:39.824372 bus /gobi_6: Setting Powered False 12:39:40.883757 run create_hlr_db(pid=23180): Terminated: ok {rc=0} 12:39:41.320189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23182): Launched 12:39:41.638905 run osmo-hlr_10.42.42.2(pid=23183): Launched 12:39:41.760660 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:42.312579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23185): Launched 12:39:42.631860 run osmo-stp_10.42.42.5(pid=23186): Launched 12:39:42.752463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:39:43.301357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23188): Launched 12:39:43.422711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:39:43.693406 run patchelf(pid=23189): Launched 12:39:43.869920 run osmo-stp_10.42.42.5(pid=23186): ERR: Terminated: ERROR {rc=1} [trial-2404↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23186)] 12:39:44.005073 run osmo-stp_10.42.42.5(pid=23186): stdout: | (launched: 2022-12-14_12:39:42.572896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:44.142075 run osmo-stp_10.42.42.5(pid=23186): stderr: | [0;m[38;5;43m20221214123942766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123942766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123942766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123942766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123942767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123942767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123942767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:44.278882 run osmo-stp_10.42.42.5(pid=23186): stdout: | (launched: 2022-12-14_12:39:42.572896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:44.408844 run osmo-stp_10.42.42.5(pid=23186): stderr: | [0;m[38;5;43m20221214123942766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214123942766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214123942766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214123942766 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214123942767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214123942767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214123942767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:44.563090 run patchelf(pid=23189): Terminating (SIGINT) 12:39:44.741762 run patchelf(pid=23189): Terminated: ok {rc=0} 12:39:44.870152 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23186): Process ended prematurely: osmo-stp_10.42.42.5(pid=23186) [trial-2404↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23186)] [trial-2404↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:39:44.879761 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:39:44.907541 run osmo-hlr_10.42.42.2(pid=23183): ERR: Terminated: ERROR {rc=237} [trial-2404↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23183)] 12:39:44.957247 run osmo-hlr_10.42.42.2(pid=23183): stdout: | (launched: 2022-12-14_12:39:41.580441) 12:39:45.008650 run osmo-hlr_10.42.42.2(pid=23183): stderr: | [0;m[1;31m20221214123941780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214123941780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214123941780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214123941780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214123941780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214123941780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214123941791 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214123941799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214123941799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214123941800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:45.060409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23182): Terminating (SIGTERM) 12:39:45.102444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23185): Terminating (SIGTERM) 12:39:45.144474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23188): Terminating (SIGTERM) 12:39:45.186368 --- ParallelTerminationStrategy: PID 23182 died... 12:39:45.206245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23182): Terminated: ok {rc=0} 12:39:45.252048 --- ParallelTerminationStrategy: PID 23185 died... 12:39:45.271465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23185): Terminated: ok {rc=0} 12:39:45.317247 --- ParallelTerminationStrategy: PID 23188 died... 12:39:45.336571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23188): Terminated: ok {rc=0} 12:39:45.423494 bus /gobi_0: Setting Powered False 12:39:46.530241 bus /gobi_0: Setting Powered False 12:39:47.660883 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2404 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 nitb_smpp --------------------------------------------------------------------- 12:39:48.912735 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:39:48.915255 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 12:39:48.935573 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 12:39:48.942306 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 12:39:48.976823 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 12:39:48.998641 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 12:39:49.005548 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 12:39:49.523903 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2404 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 12:39:49.530153 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:39:49.549114 tst esme_connect_policy_acceptall.py: using MSISDN 8683 12:39:49.689436 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:39:50.294224 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23193): Launched 12:39:50.617729 run osmo-nitb_10.42.42.2(pid=23194): Launched 12:39:50.797635 run osmo-nitb_10.42.42.2(pid=23194): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23194)] 12:39:50.941757 run osmo-nitb_10.42.42.2(pid=23194): stdout: | (launched: 2022-12-14_12:39:50.557769) 12:39:51.088321 run osmo-nitb_10.42.42.2(pid=23194): stderr: | (launched: 2022-12-14_12:39:50.606288) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:39:51.234428 run osmo-nitb_10.42.42.2(pid=23194): stdout: | (launched: 2022-12-14_12:39:50.557769) 12:39:51.374388 run osmo-nitb_10.42.42.2(pid=23194): stderr: | (launched: 2022-12-14_12:39:50.606288) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23194): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23194) [trial-2404↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23194)] 12:39:51.741176 tst osmo-nitb_10.42.42.2(pid=23194): stdout: | (launched: 2022-12-14_12:39:50.557769) 12:39:51.871213 tst osmo-nitb_10.42.42.2(pid=23194): stderr: | (launched: 2022-12-14_12:39:50.606288) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:39:52.025253 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=23194): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23194) [trial-2404↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23194)] [trial-2404↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 12:39:52.034565 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 12:39:52.041796 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23193): Terminating (SIGTERM) 12:39:52.252183 --- ParallelTerminationStrategy: PID 23193 died... 12:39:52.273646 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23193): Terminated: ok {rc=0} ---------------------------------------------- trial-2404 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 12:39:52.324872 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:39:52.346751 tst esme_connect_policy_closed.py: using MSISDN 8684 12:39:52.476299 tst esme_connect_policy_closed.py: using MSISDN 8685 12:39:52.594835 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:39:53.199415 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23195): Launched 12:39:53.525959 run osmo-nitb_10.42.42.2(pid=23196): Launched 12:39:53.702980 run osmo-nitb_10.42.42.2(pid=23196): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23196)] 12:39:53.835935 run osmo-nitb_10.42.42.2(pid=23196): stdout: | (launched: 2022-12-14_12:39:53.465989) 12:39:53.970600 run osmo-nitb_10.42.42.2(pid=23196): stderr: | (launched: 2022-12-14_12:39:53.514436) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:39:54.105514 run osmo-nitb_10.42.42.2(pid=23196): stdout: | (launched: 2022-12-14_12:39:53.465989) 12:39:54.234389 run osmo-nitb_10.42.42.2(pid=23196): stderr: | (launched: 2022-12-14_12:39:53.514436) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:39:54.389040 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=23196): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23196) [trial-2404↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23196)] [trial-2404↪nitb_smpp↪esme_connect_policy_closed.py:24] 12:39:54.398341 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 12:39:54.405316 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23195): Terminating (SIGTERM) 12:39:54.615563 --- ParallelTerminationStrategy: PID 23195 died... 12:39:54.636919 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23195): Terminated: ok {rc=0} ---------------------------------------------- trial-2404 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 12:39:54.687947 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:39:54.699561 tst nitb_smpp: Using 1 x bts (candidates: 1) 12:39:54.735266 tst esme_ms_sms_storeforward.py: using LAC 40959 12:39:54.863513 tst esme_ms_sms_storeforward.py: using RAC 159 12:39:54.990825 tst esme_ms_sms_storeforward.py: using CellId 40959 12:39:55.119593 tst esme_ms_sms_storeforward.py: using BVCI 40960 12:39:55.237613 tst nitb_smpp: Using 1 x modem (candidates: 1) 12:39:55.363495 tst esme_ms_sms_storeforward.py: using MSISDN 8686 12:39:55.472920 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 12:39:55.677512 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:39:56.297300 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23197): Launched 12:39:56.602446 run osmo-nitb_10.42.42.2(pid=23198): Launched 12:39:56.766831 run osmo-nitb_10.42.42.2(pid=23198): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23198)] 12:39:56.892710 run osmo-nitb_10.42.42.2(pid=23198): stdout: | (launched: 2022-12-14_12:39:56.546096) 12:39:57.019916 run osmo-nitb_10.42.42.2(pid=23198): stderr: | (launched: 2022-12-14_12:39:56.591358) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:39:57.147010 run osmo-nitb_10.42.42.2(pid=23198): stdout: | (launched: 2022-12-14_12:39:56.546096) 12:39:57.267927 run osmo-nitb_10.42.42.2(pid=23198): stderr: | (launched: 2022-12-14_12:39:56.591358) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:39:57.412690 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=23198): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23198) [trial-2404↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23198)] [trial-2404↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 12:39:57.421161 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 12:39:57.427660 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23197): Terminating (SIGTERM) 12:39:57.636663 --- ParallelTerminationStrategy: PID 23197 died... 12:39:57.657150 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23197): Terminated: ok {rc=0} 12:39:57.743735 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 12:39:58.832599 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:39:58.843928 tst nitb_smpp: Using 1 x bts (candidates: 1) 12:39:58.879217 tst esme_ms_sms_transaction.py: using LAC 40960 12:39:59.001416 tst esme_ms_sms_transaction.py: using RAC 160 12:39:59.129798 tst esme_ms_sms_transaction.py: using CellId 40960 12:39:59.257663 tst esme_ms_sms_transaction.py: using BVCI 40961 12:39:59.375801 tst nitb_smpp: Using 1 x modem (candidates: 1) 12:39:59.505093 tst esme_ms_sms_transaction.py: using MSISDN 8687 12:39:59.624812 tst esme_ms_sms_transaction.py:18: start nitb and bts... 12:39:59.844563 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:40:00.502991 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23199): Launched 12:40:00.830067 run osmo-nitb_10.42.42.2(pid=23200): Launched 12:40:01.034746 run osmo-nitb_10.42.42.2(pid=23200): ERR: Terminated: ERROR {rc=2} [trial-2404↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23200)] 12:40:01.178156 run osmo-nitb_10.42.42.2(pid=23200): stdout: | (launched: 2022-12-14_12:40:00.770149) 12:40:01.321077 run osmo-nitb_10.42.42.2(pid=23200): stderr: | (launched: 2022-12-14_12:40:00.818407) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:40:01.467068 run osmo-nitb_10.42.42.2(pid=23200): stdout: | (launched: 2022-12-14_12:40:00.770149) 12:40:01.605732 run osmo-nitb_10.42.42.2(pid=23200): stderr: | (launched: 2022-12-14_12:40:00.818407) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8c7c712268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23200): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23200) [trial-2404↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23200)] 12:40:01.970883 tst osmo-nitb_10.42.42.2(pid=23200): stdout: | (launched: 2022-12-14_12:40:00.770149) 12:40:02.107624 tst osmo-nitb_10.42.42.2(pid=23200): stderr: | (launched: 2022-12-14_12:40:00.818407) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:40:02.271281 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=23200): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23200) [trial-2404↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23200)] [trial-2404↪nitb_smpp↪esme_ms_sms_transaction.py:21] 12:40:02.280775 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 12:40:02.288014 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23199): Terminating (SIGTERM) 12:40:02.499015 --- ParallelTerminationStrategy: PID 23199 died... 12:40:02.520565 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23199): Terminated: ok {rc=0} 12:40:02.610495 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 smpp --------------------------------------------------------------------- 12:40:03.778343 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:03.781530 tst smpp: Verifying 1 x bts (candidates: 11) 12:40:03.802348 tst smpp: Verifying 6 x ip_address (candidates: 9) 12:40:03.830764 tst smpp: Verifying 1 x modem (candidates: 12) 12:40:03.866326 tst smpp: Reserving 1 x bts (candidates: 11) 12:40:03.887013 tst smpp: Reserving 6 x ip_address (candidates: 9) 12:40:03.913486 tst smpp: Reserving 1 x modem (candidates: 12) 12:40:04.442802 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 12:40:04.448267 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:04.459340 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:04.470406 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:04.481353 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:04.504120 tst esme_connect_policy_acceptall.py: using MSISDN 8688 12:40:04.618344 run osmo-stp_10.42.42.4: Starting osmo-stp 12:40:05.135242 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23207): Launched 12:40:05.439349 run osmo-stp_10.42.42.4(pid=23208): Launched 12:40:05.555439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:06.026632 run create_hlr_db(pid=23209): Launched 12:40:06.141387 bus /sierra_2: Setting Powered False 12:40:07.201876 run create_hlr_db(pid=23209): Terminated: ok {rc=0} 12:40:07.627706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23211): Launched 12:40:07.931311 run osmo-hlr_10.42.42.2(pid=23212): Launched 12:40:08.046914 run osmo-msc_10.42.42.5: Starting osmo-msc 12:40:08.598357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23214): Launched 12:40:08.902380 run osmo-msc_10.42.42.5(pid=23215): Launched 12:40:09.071815 run osmo-hlr_10.42.42.2(pid=23212): ERR: Terminated: ERROR {rc=237} [trial-2404↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23212)] 12:40:09.201189 run osmo-hlr_10.42.42.2(pid=23212): stdout: | (launched: 2022-12-14_12:40:07.874899) 12:40:09.332196 run osmo-hlr_10.42.42.2(pid=23212): stderr: | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124008080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124008089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124008089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124008089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:09.458776 run osmo-hlr_10.42.42.2(pid=23212): stdout: | (launched: 2022-12-14_12:40:07.874899) 12:40:09.579693 run osmo-hlr_10.42.42.2(pid=23212): stderr: | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124008050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124008080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124008089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124008089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124008089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:09.724760 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=23212): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23212) [trial-2404↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23212)] [trial-2404↪smpp↪esme_connect_policy_acceptall.py:23] 12:40:09.733196 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.3 sec) 12:40:09.759211 run osmo-msc_10.42.42.5(pid=23215): ERR: Terminated: ERROR {rc=9} [trial-2404↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=23215)] 12:40:09.808206 run osmo-msc_10.42.42.5(pid=23215): stdout: | (launched: 2022-12-14_12:40:08.845953) 12:40:09.857923 run osmo-msc_10.42.42.5(pid=23215): stderr: | [0;m[38;5;43m20221214124009165 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214124009165 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214124009166 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214124009166 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214124009166 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214124009166 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214124009166 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214124009166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214124009166 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 12:40:09.908118 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23207): Terminating (SIGTERM) 12:40:09.948459 run osmo-stp_10.42.42.4(pid=23208): Terminating (SIGTERM) 12:40:09.988587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23211): Terminating (SIGTERM) 12:40:10.030211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23214): Terminating (SIGTERM) 12:40:10.071422 --- ParallelTerminationStrategy: PID 23207 died... 12:40:10.091083 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23207): Terminated: ok {rc=0} 12:40:10.135148 --- ParallelTerminationStrategy: PID 23208 died... 12:40:10.153949 run osmo-stp_10.42.42.4(pid=23208): Terminated: ok {rc=0} 12:40:10.198222 --- ParallelTerminationStrategy: PID 23211 died... 12:40:10.217134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23211): Terminated: ok {rc=0} 12:40:10.261193 --- ParallelTerminationStrategy: PID 23214 died... 12:40:10.280000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23214): Terminated: ok {rc=0} ---------------------------------------------- trial-2404 smpp esme_connect_policy_closed.py ---------------------------------------------- 12:40:10.329547 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:10.340840 tst smpp: Using 1 x bts (candidates: 1) 12:40:10.375965 tst esme_connect_policy_closed.py: using LAC 40961 12:40:10.502413 tst esme_connect_policy_closed.py: using RAC 161 12:40:10.625615 tst esme_connect_policy_closed.py: using CellId 40961 12:40:10.744838 tst esme_connect_policy_closed.py: using BVCI 40962 12:40:10.854862 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:10.865439 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:10.875855 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:10.894621 tst esme_connect_policy_closed.py: using MSISDN 8689 12:40:11.012587 tst esme_connect_policy_closed.py: using MSISDN 8690 12:40:11.121989 run osmo-stp_10.42.42.4: Starting osmo-stp 12:40:11.638976 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23218): Launched 12:40:11.944922 run osmo-stp_10.42.42.4(pid=23219): Launched 12:40:12.060291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:12.531430 run create_hlr_db(pid=23220): Launched 12:40:13.701305 run create_hlr_db(pid=23220): Terminated: ok {rc=0} 12:40:14.022940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23222): Launched 12:40:14.328160 run osmo-hlr_10.42.42.2(pid=23223): Launched 12:40:14.446301 run osmo-msc_10.42.42.5: Starting osmo-msc 12:40:14.999498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23225): Launched 12:40:15.305238 run osmo-msc_10.42.42.5(pid=23226): Launched 12:40:15.475325 run osmo-hlr_10.42.42.2(pid=23223): ERR: Terminated: ERROR {rc=237} [trial-2404↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23223)] 12:40:15.609582 run osmo-hlr_10.42.42.2(pid=23223): stdout: | (launched: 2022-12-14_12:40:14.270900) 12:40:15.750514 run osmo-hlr_10.42.42.2(pid=23223): stderr: | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124014475 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124014484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124014484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124014484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:15.920098 run osmo-hlr_10.42.42.2(pid=23223): stdout: | (launched: 2022-12-14_12:40:14.270900) 12:40:16.051597 run osmo-hlr_10.42.42.2(pid=23223): stderr: | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124014448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124014475 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124014484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124014484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124014484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:16.213735 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=23223): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23223) [trial-2404↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23223)] [trial-2404↪smpp↪esme_connect_policy_closed.py:31] 12:40:16.223762 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 12:40:16.252460 run osmo-msc_10.42.42.5(pid=23226): ERR: Terminated: ERROR {rc=9} [trial-2404↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=23226)] 12:40:16.304712 run osmo-msc_10.42.42.5(pid=23226): stdout: | (launched: 2022-12-14_12:40:15.248572) 12:40:16.360013 run osmo-msc_10.42.42.5(pid=23226): stderr: | [0;m[38;5;43m20221214124015564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214124015564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214124015564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214124015564 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214124015564 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214124015564 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214124015564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214124015565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214124015565 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 12:40:16.413835 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23218): Terminating (SIGTERM) 12:40:16.458666 run osmo-stp_10.42.42.4(pid=23219): Terminating (SIGTERM) 12:40:16.510594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23222): Terminating (SIGTERM) 12:40:16.557209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23225): Terminating (SIGTERM) 12:40:16.628625 --- ParallelTerminationStrategy: PID 23218 died... 12:40:16.668136 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23218): Terminated: ok {rc=0} 12:40:16.744880 --- ParallelTerminationStrategy: PID 23219 died... 12:40:16.765346 run osmo-stp_10.42.42.4(pid=23219): Terminated: ok {rc=0} 12:40:16.813205 --- ParallelTerminationStrategy: PID 23222 died... 12:40:16.833614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23222): Terminated: ok {rc=0} 12:40:16.881079 --- ParallelTerminationStrategy: PID 23225 died... 12:40:16.901425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23225): Terminated: ok {rc=0} ---------------------------------------------- trial-2404 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 12:40:16.955486 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:16.967544 tst smpp: Using 1 x bts (candidates: 1) 12:40:17.005318 tst esme_ms_sms_storeforward.py: using LAC 40962 12:40:17.143735 tst esme_ms_sms_storeforward.py: using RAC 162 12:40:17.273640 tst esme_ms_sms_storeforward.py: using CellId 40962 12:40:17.401651 tst esme_ms_sms_storeforward.py: using BVCI 40963 12:40:17.522069 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:17.533213 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:17.544082 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:17.554968 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:17.566232 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:17.577185 tst smpp: Using 1 x modem (candidates: 1) 12:40:17.705253 tst esme_ms_sms_storeforward.py: using MSISDN 8691 12:40:17.818199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:18.290820 run create_hlr_db(pid=23229): Launched 12:40:19.463473 run create_hlr_db(pid=23229): Terminated: ok {rc=0} 12:40:19.786493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23231): Launched 12:40:20.091223 run osmo-hlr_10.42.42.2(pid=23232): Launched 12:40:20.208414 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:20.736201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23234): Launched 12:40:21.042258 run osmo-stp_10.42.42.5(pid=23235): Launched 12:40:21.158877 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:21.709925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23237): Launched 12:40:22.017265 run osmo-msc_10.42.42.6(pid=23238): Launched 12:40:22.187765 run osmo-stp_10.42.42.5(pid=23235): ERR: Terminated: ERROR {rc=1} [trial-2404↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23235)] 12:40:22.317326 run osmo-stp_10.42.42.5(pid=23235): stdout: | (launched: 2022-12-14_12:40:20.985491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:22.446545 run osmo-stp_10.42.42.5(pid=23235): stderr: | [0;m[38;5;43m20221214124021159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124021159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124021159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124021160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124021160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124021160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124021160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:22.573462 run osmo-stp_10.42.42.5(pid=23235): stdout: | (launched: 2022-12-14_12:40:20.985491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:22.694705 run osmo-stp_10.42.42.5(pid=23235): stderr: | [0;m[38;5;43m20221214124021159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124021159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124021159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124021160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124021160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124021160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124021160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:22.839603 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=23235): Process ended prematurely: osmo-stp_10.42.42.5(pid=23235) [trial-2404↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23235)] [trial-2404↪smpp↪esme_ms_sms_storeforward.py:30] 12:40:22.848048 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.9 sec) 12:40:22.874120 run osmo-hlr_10.42.42.2(pid=23232): ERR: Terminated: ERROR {rc=237} [trial-2404↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23232)] 12:40:22.922334 run osmo-hlr_10.42.42.2(pid=23232): stdout: | (launched: 2022-12-14_12:40:20.034697) 12:40:22.971697 run osmo-hlr_10.42.42.2(pid=23232): stderr: | [0;m[1;31m20221214124020213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124020213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124020213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124020213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124020213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124020213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124020260 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124020269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124020269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124020269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:23.041200 run osmo-msc_10.42.42.6(pid=23238): ERR: Terminated: ERROR {rc=2} [trial-2404↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23238)] 12:40:23.088786 run osmo-msc_10.42.42.6(pid=23238): stdout: | (launched: 2022-12-14_12:40:21.960724) 12:40:23.138296 run osmo-msc_10.42.42.6(pid=23238): stderr: | [0;m[38;5;43m20221214124022232 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124022233 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f430e15cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124022233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124022233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124022233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124022233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124022235 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124022236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124022236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124022236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:23.188031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23231): Terminating (SIGTERM) 12:40:23.228218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23234): Terminating (SIGTERM) 12:40:23.268665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23237): Terminating (SIGTERM) 12:40:23.309344 --- ParallelTerminationStrategy: PID 23231 died... 12:40:23.328832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23231): Terminated: ok {rc=0} 12:40:23.373337 --- ParallelTerminationStrategy: PID 23234 died... 12:40:23.392224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23234): Terminated: ok {rc=0} 12:40:23.436067 --- ParallelTerminationStrategy: PID 23237 died... 12:40:23.455113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23237): Terminated: ok {rc=0} 12:40:23.540269 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 smpp esme_ms_sms_transaction.py ---------------------------------------------- 12:40:24.627372 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:24.639514 tst smpp: Using 1 x bts (candidates: 1) 12:40:24.677812 tst esme_ms_sms_transaction.py: using LAC 40963 12:40:24.806867 tst esme_ms_sms_transaction.py: using RAC 163 12:40:24.935862 tst esme_ms_sms_transaction.py: using CellId 40963 12:40:25.064514 tst esme_ms_sms_transaction.py: using BVCI 40964 12:40:25.184216 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:25.195117 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:25.205922 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:25.217289 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:25.228601 tst smpp: Using 1 x ip_address (candidates: 6) 12:40:25.240035 tst smpp: Using 1 x modem (candidates: 1) 12:40:25.373316 tst esme_ms_sms_transaction.py: using MSISDN 8692 12:40:25.493322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:26.000640 run create_hlr_db(pid=23240): Launched 12:40:26.131784 bus /sierra_2: Setting Powered False 12:40:27.196846 run create_hlr_db(pid=23240): Terminated: ok {rc=0} 12:40:27.635197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23242): Launched 12:40:27.942470 run osmo-hlr_10.42.42.2(pid=23243): Launched 12:40:28.058531 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:28.600310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23245): Launched 12:40:28.906093 run osmo-stp_10.42.42.5(pid=23246): Launched 12:40:29.022513 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:29.573687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23248): Launched 12:40:29.879327 run osmo-msc_10.42.42.6(pid=23249): Launched 12:40:30.048621 run osmo-stp_10.42.42.5(pid=23246): ERR: Terminated: ERROR {rc=1} [trial-2404↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23246)] 12:40:30.178827 run osmo-stp_10.42.42.5(pid=23246): stdout: | (launched: 2022-12-14_12:40:28.848796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:30.308049 run osmo-stp_10.42.42.5(pid=23246): stderr: | [0;m[38;5;43m20221214124029020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124029020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124029021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124029021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124029022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124029022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124029022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:30.435515 run osmo-stp_10.42.42.5(pid=23246): stdout: | (launched: 2022-12-14_12:40:28.848796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:30.556600 run osmo-stp_10.42.42.5(pid=23246): stderr: | [0;m[38;5;43m20221214124029020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124029020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124029021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124029021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124029022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124029022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124029022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:30.702150 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=23246): Process ended prematurely: osmo-stp_10.42.42.5(pid=23246) [trial-2404↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23246)] [trial-2404↪smpp↪esme_ms_sms_transaction.py:28] 12:40:30.710655 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 12:40:30.736620 run osmo-hlr_10.42.42.2(pid=23243): ERR: Terminated: ERROR {rc=237} [trial-2404↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23243)] 12:40:30.785626 run osmo-hlr_10.42.42.2(pid=23243): stdout: | (launched: 2022-12-14_12:40:27.885767) 12:40:30.841231 run osmo-hlr_10.42.42.2(pid=23243): stderr: | [0;m[1;31m20221214124028064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124028064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124028064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124028064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124028064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124028064 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124028076 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124028085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124028086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124028086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:30.931651 run osmo-msc_10.42.42.6(pid=23249): ERR: Terminated: ERROR {rc=2} [trial-2404↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23249)] 12:40:30.988388 run osmo-msc_10.42.42.6(pid=23249): stdout: | (launched: 2022-12-14_12:40:29.822897) 12:40:31.041297 run osmo-msc_10.42.42.6(pid=23249): stderr: | [0;m[38;5;43m20221214124030094 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124030095 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c1e6afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124030095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124030095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124030095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124030095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124030099 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124030099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124030099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124030099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:31.094589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23242): Terminating (SIGTERM) 12:40:31.139700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23245): Terminating (SIGTERM) 12:40:31.184997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23248): Terminating (SIGTERM) 12:40:31.231035 --- ParallelTerminationStrategy: PID 23242 died... 12:40:31.251594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23242): Terminated: ok {rc=0} 12:40:31.300443 --- ParallelTerminationStrategy: PID 23245 died... 12:40:31.321266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23245): Terminated: ok {rc=0} 12:40:31.369944 --- ParallelTerminationStrategy: PID 23248 died... 12:40:31.390401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23248): Terminated: ok {rc=0} 12:40:31.480442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 encryption --------------------------------------------------------------------- 12:40:32.678374 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:32.681852 tst encryption: Verifying 1 x bts (candidates: 11) 12:40:32.703164 tst encryption: Verifying 6 x ip_address (candidates: 9) 12:40:32.730761 tst encryption: Verifying 1 x modem (candidates: 12) 12:40:32.766962 tst encryption: Reserving 1 x bts (candidates: 11) 12:40:32.788313 tst encryption: Reserving 6 x ip_address (candidates: 9) 12:40:32.815505 tst encryption: Reserving 1 x modem (candidates: 12) 12:40:33.344246 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2404 encryption register_a5_0_authopt.py ---------------------------------------------- 12:40:33.399355 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:33.410407 tst encryption: Using 1 x bts (candidates: 1) 12:40:33.445943 tst register_a5_0_authopt.py: using LAC 40964 12:40:33.578888 tst register_a5_0_authopt.py: using RAC 164 12:40:33.708897 tst register_a5_0_authopt.py: using CellId 40964 12:40:33.835954 tst register_a5_0_authopt.py: using BVCI 40965 12:40:33.955412 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:33.966406 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:33.977329 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:33.988034 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:33.998854 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:34.009616 tst encryption: Using 1 x modem (candidates: 1) 12:40:34.133165 tst register_a5_0_authopt.py:8: start network... 12:40:34.357093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:34.869500 run create_hlr_db(pid=23254): Launched 12:40:35.002536 bus /sierra_2: Setting Powered False 12:40:36.067715 run create_hlr_db(pid=23254): Terminated: ok {rc=0} 12:40:36.507210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23256): Launched 12:40:36.816898 run osmo-hlr_10.42.42.2(pid=23257): Launched 12:40:36.935100 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:37.464886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23259): Launched 12:40:37.772780 run osmo-stp_10.42.42.5(pid=23260): Launched 12:40:37.890612 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:38.446175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23262): Launched 12:40:38.755962 run osmo-msc_10.42.42.6(pid=23263): Launched 12:40:38.928666 run osmo-stp_10.42.42.5(pid=23260): ERR: Terminated: ERROR {rc=1} [trial-2404↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23260)] 12:40:39.059993 run osmo-stp_10.42.42.5(pid=23260): stdout: | (launched: 2022-12-14_12:40:37.715794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:39.191004 run osmo-stp_10.42.42.5(pid=23260): stderr: | [0;m[38;5;43m20221214124037889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124037890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124037890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124037890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124037891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124037891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124037891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:39.319283 run osmo-stp_10.42.42.5(pid=23260): stdout: | (launched: 2022-12-14_12:40:37.715794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:39.442147 run osmo-stp_10.42.42.5(pid=23260): stderr: | [0;m[38;5;43m20221214124037889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124037890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124037890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124037890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124037891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124037891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124037891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:39.588826 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23260): Process ended prematurely: osmo-stp_10.42.42.5(pid=23260) [trial-2404↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23260)] [trial-2404↪encryption↪register_a5_0_authopt.py:8] 12:40:39.597963 tst register_a5_0_authopt.py:8: Test FAILED (6.2 sec) 12:40:39.624230 run osmo-hlr_10.42.42.2(pid=23257): ERR: Terminated: ERROR {rc=237} [trial-2404↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23257)] 12:40:39.672478 run osmo-hlr_10.42.42.2(pid=23257): stdout: | (launched: 2022-12-14_12:40:36.759820) 12:40:39.721905 run osmo-hlr_10.42.42.2(pid=23257): stderr: | [0;m[1;31m20221214124036939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124036940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124036940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124036940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124036940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124036940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124036952 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124036962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124036962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124036962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:39.791094 run osmo-msc_10.42.42.6(pid=23263): ERR: Terminated: ERROR {rc=2} [trial-2404↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23263)] 12:40:39.838500 run osmo-msc_10.42.42.6(pid=23263): stdout: | (launched: 2022-12-14_12:40:38.698987) 12:40:39.887941 run osmo-msc_10.42.42.6(pid=23263): stderr: | [0;m[38;5;43m20221214124038972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124038972 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f264bbb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124038972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124038972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124038972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124038973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124038974 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124038975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124038975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124038975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:39.937985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23256): Terminating (SIGTERM) 12:40:39.978216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23259): Terminating (SIGTERM) 12:40:40.018370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23262): Terminating (SIGTERM) 12:40:40.058626 --- ParallelTerminationStrategy: PID 23256 died... 12:40:40.078217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23256): Terminated: ok {rc=0} 12:40:40.122397 --- ParallelTerminationStrategy: PID 23259 died... 12:40:40.141366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23259): Terminated: ok {rc=0} 12:40:40.185199 --- ParallelTerminationStrategy: PID 23262 died... 12:40:40.204137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23262): Terminated: ok {rc=0} 12:40:40.287766 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 encryption register_a5_0_authreq.py ---------------------------------------------- 12:40:41.432486 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:41.443918 tst encryption: Using 1 x bts (candidates: 1) 12:40:41.479690 tst register_a5_0_authreq.py: using LAC 40965 12:40:41.608799 tst register_a5_0_authreq.py: using RAC 165 12:40:41.738848 tst register_a5_0_authreq.py: using CellId 40965 12:40:41.869950 tst register_a5_0_authreq.py: using BVCI 40966 12:40:41.991977 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:42.003167 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:42.014188 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:42.025064 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:42.035942 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:42.046740 tst encryption: Using 1 x modem (candidates: 1) 12:40:42.167727 tst register_a5_0_authreq.py:8: start network... 12:40:42.393424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:42.906018 run create_hlr_db(pid=23265): Launched 12:40:43.039238 bus /sierra_2: Setting Powered False 12:40:44.104653 run create_hlr_db(pid=23265): Terminated: ok {rc=0} 12:40:44.546426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23267): Launched 12:40:44.856490 run osmo-hlr_10.42.42.2(pid=23268): Launched 12:40:44.973963 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:45.519122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23270): Launched 12:40:45.830856 run osmo-stp_10.42.42.5(pid=23271): Launched 12:40:46.121741 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:46.748456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23273): Launched 12:40:47.077557 run osmo-msc_10.42.42.6(pid=23274): Launched 12:40:47.492077 run osmo-stp_10.42.42.5(pid=23271): ERR: Terminated: ERROR {rc=1} [trial-2404↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23271)] 12:40:47.647726 run osmo-stp_10.42.42.5(pid=23271): stdout: | (launched: 2022-12-14_12:40:45.770757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:47.787823 run osmo-stp_10.42.42.5(pid=23271): stderr: | [0;m[38;5;43m20221214124045991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124045991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124045991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124045992 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124045992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124045992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124045992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:47.925918 run osmo-stp_10.42.42.5(pid=23271): stdout: | (launched: 2022-12-14_12:40:45.770757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:48.058449 run osmo-stp_10.42.42.5(pid=23271): stderr: | [0;m[38;5;43m20221214124045991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124045991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124045991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124045992 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124045992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124045992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124045992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:48.215789 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23271): Process ended prematurely: osmo-stp_10.42.42.5(pid=23271) [trial-2404↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23271)] [trial-2404↪encryption↪register_a5_0_authreq.py:8] 12:40:48.225774 tst register_a5_0_authreq.py:8: Test FAILED (6.8 sec) 12:40:48.253829 run osmo-hlr_10.42.42.2(pid=23268): ERR: Terminated: ERROR {rc=237} [trial-2404↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23268)] 12:40:48.304243 run osmo-hlr_10.42.42.2(pid=23268): stdout: | (launched: 2022-12-14_12:40:44.799399) 12:40:48.356058 run osmo-hlr_10.42.42.2(pid=23268): stderr: | [0;m[1;31m20221214124044977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124044977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124044977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124044977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124044977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124044977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124044989 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124044997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124044998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124044998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:48.428497 run osmo-msc_10.42.42.6(pid=23274): ERR: Terminated: ERROR {rc=2} [trial-2404↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23274)] 12:40:48.478708 run osmo-msc_10.42.42.6(pid=23274): stdout: | (launched: 2022-12-14_12:40:47.017324) 12:40:48.530494 run osmo-msc_10.42.42.6(pid=23274): stderr: | [0;m[38;5;43m20221214124047394 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124047395 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4521ff3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124047397 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124047397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124047397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124047397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124047403 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124047404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124047413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124047413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:48.583126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23267): Terminating (SIGTERM) 12:40:48.625834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23270): Terminating (SIGTERM) 12:40:48.668192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23273): Terminating (SIGTERM) 12:40:48.710844 --- ParallelTerminationStrategy: PID 23267 died... 12:40:48.731301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23267): Terminated: ok {rc=0} 12:40:48.777983 --- ParallelTerminationStrategy: PID 23270 died... 12:40:48.797895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23270): Terminated: ok {rc=0} 12:40:48.844186 --- ParallelTerminationStrategy: PID 23273 died... 12:40:48.864070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23273): Terminated: ok {rc=0} 12:40:48.951387 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 encryption register_a5_1_authreq.py ---------------------------------------------- 12:40:50.102942 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:50.114866 tst encryption: Using 1 x bts (candidates: 1) 12:40:50.151532 tst register_a5_1_authreq.py: using LAC 40966 12:40:50.281057 tst register_a5_1_authreq.py: using RAC 166 12:40:50.410883 tst register_a5_1_authreq.py: using CellId 40966 12:40:50.544194 tst register_a5_1_authreq.py: using BVCI 40967 12:40:50.659429 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:50.670145 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:50.680529 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:50.690923 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:50.701214 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:50.712663 tst encryption: Using 1 x modem (candidates: 1) 12:40:50.830030 tst register_a5_1_authreq.py:8: start network... 12:40:51.038571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:51.516920 run create_hlr_db(pid=23276): Launched 12:40:51.635340 bus /sierra_2: Setting Powered False 12:40:52.696233 run create_hlr_db(pid=23276): Terminated: ok {rc=0} 12:40:53.128400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23278): Launched 12:40:53.439825 run osmo-hlr_10.42.42.2(pid=23279): Launched 12:40:53.558327 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:54.107119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23281): Launched 12:40:54.418289 run osmo-stp_10.42.42.5(pid=23282): Launched 12:40:54.536709 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:55.094269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23284): Launched 12:40:55.405268 run osmo-msc_10.42.42.6(pid=23285): Launched 12:40:55.578648 run osmo-stp_10.42.42.5(pid=23282): ERR: Terminated: ERROR {rc=1} [trial-2404↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23282)] 12:40:55.709873 run osmo-stp_10.42.42.5(pid=23282): stdout: | (launched: 2022-12-14_12:40:54.361071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:55.840774 run osmo-stp_10.42.42.5(pid=23282): stderr: | [0;m[38;5;43m20221214124054531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124054531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124054532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124054532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124054532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124054533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124054533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:55.970092 run osmo-stp_10.42.42.5(pid=23282): stdout: | (launched: 2022-12-14_12:40:54.361071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:56.093388 run osmo-stp_10.42.42.5(pid=23282): stderr: | [0;m[38;5;43m20221214124054531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124054531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124054532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124054532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124054532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124054533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124054533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:56.240846 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23282): Process ended prematurely: osmo-stp_10.42.42.5(pid=23282) [trial-2404↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23282)] [trial-2404↪encryption↪register_a5_1_authreq.py:8] 12:40:56.249789 tst register_a5_1_authreq.py:8: Test FAILED (6.2 sec) 12:40:56.275906 run osmo-hlr_10.42.42.2(pid=23279): ERR: Terminated: ERROR {rc=237} [trial-2404↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23279)] 12:40:56.323981 run osmo-hlr_10.42.42.2(pid=23279): stdout: | (launched: 2022-12-14_12:40:53.382799) 12:40:56.373499 run osmo-hlr_10.42.42.2(pid=23279): stderr: | [0;m[1;31m20221214124053564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124053564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124053564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124053564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124053564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124053564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124053575 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124053584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124053584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124053584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:56.443016 run osmo-msc_10.42.42.6(pid=23285): ERR: Terminated: ERROR {rc=2} [trial-2404↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23285)] 12:40:56.490600 run osmo-msc_10.42.42.6(pid=23285): stdout: | (launched: 2022-12-14_12:40:55.347930) 12:40:56.540087 run osmo-msc_10.42.42.6(pid=23285): stderr: | [0;m[38;5;43m20221214124055620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124055620 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f327d7e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124055620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124055620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124055620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124055621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124055622 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124055623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124055623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124055623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:56.590159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23278): Terminating (SIGTERM) 12:40:56.630592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23281): Terminating (SIGTERM) 12:40:56.670947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23284): Terminating (SIGTERM) 12:40:56.711445 --- ParallelTerminationStrategy: PID 23278 died... 12:40:56.730893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23278): Terminated: ok {rc=0} 12:40:56.775533 --- ParallelTerminationStrategy: PID 23281 died... 12:40:56.794426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23281): Terminated: ok {rc=0} 12:40:56.838718 --- ParallelTerminationStrategy: PID 23284 died... 12:40:56.857694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23284): Terminated: ok {rc=0} 12:40:56.944184 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2404 encryption register_a5_3_authreq.py ---------------------------------------------- 12:40:58.099852 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:58.111733 tst encryption: Using 1 x bts (candidates: 1) 12:40:58.149473 tst register_a5_3_authreq.py: using LAC 40967 12:40:58.278444 tst register_a5_3_authreq.py: using RAC 167 12:40:58.399678 tst register_a5_3_authreq.py: using CellId 40967 12:40:58.519850 tst register_a5_3_authreq.py: using BVCI 40968 12:40:58.632799 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:58.643431 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:58.653899 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:58.664264 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:58.674551 tst encryption: Using 1 x ip_address (candidates: 6) 12:40:58.686282 tst encryption: Using 1 x modem (candidates: 1) 12:40:58.819680 tst register_a5_3_authreq.py:8: start network... 12:40:59.043627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:59.553619 run create_hlr_db(pid=23287): Launched 12:40:59.687967 bus /sierra_2: Setting Powered False 12:41:00.752455 run create_hlr_db(pid=23287): Terminated: ok {rc=0} 12:41:01.238112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23289): Launched 12:41:01.589708 run osmo-hlr_10.42.42.2(pid=23290): Launched 12:41:01.952334 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:02.572283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23292): Launched 12:41:02.904097 run osmo-stp_10.42.42.5(pid=23293): Launched 12:41:03.029910 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:03.626115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23295): Launched 12:41:03.958741 run osmo-msc_10.42.42.6(pid=23296): Launched 12:41:04.143986 run osmo-stp_10.42.42.5(pid=23293): ERR: Terminated: ERROR {rc=1} [trial-2404↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23293)] 12:41:04.283483 run osmo-stp_10.42.42.5(pid=23293): stdout: | (launched: 2022-12-14_12:41:02.843063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:04.423093 run osmo-stp_10.42.42.5(pid=23293): stderr: | [0;m[38;5;43m20221214124103038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124103038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124103039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124103039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124103039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124103039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:04.561361 run osmo-stp_10.42.42.5(pid=23293): stdout: | (launched: 2022-12-14_12:41:02.843063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:04.693112 run osmo-stp_10.42.42.5(pid=23293): stderr: | [0;m[38;5;43m20221214124103038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124103038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124103039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124103039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124103039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124103039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124103039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:04.849970 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23293): Process ended prematurely: osmo-stp_10.42.42.5(pid=23293) [trial-2404↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23293)] [trial-2404↪encryption↪register_a5_3_authreq.py:8] 12:41:04.859577 tst register_a5_3_authreq.py:8: Test FAILED (6.8 sec) 12:41:04.886833 run osmo-hlr_10.42.42.2(pid=23290): ERR: Terminated: ERROR {rc=237} [trial-2404↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23290)] 12:41:04.936866 run osmo-hlr_10.42.42.2(pid=23290): stdout: | (launched: 2022-12-14_12:41:01.524874) 12:41:04.988433 run osmo-hlr_10.42.42.2(pid=23290): stderr: | [0;m[1;31m20221214124101836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124101836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124101836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124101836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124101836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124101836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124101857 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124101884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124101885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124101885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:05.060308 run osmo-msc_10.42.42.6(pid=23296): ERR: Terminated: ERROR {rc=2} [trial-2404↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23296)] 12:41:05.110003 run osmo-msc_10.42.42.6(pid=23296): stdout: | (launched: 2022-12-14_12:41:03.898204) 12:41:05.161296 run osmo-msc_10.42.42.6(pid=23296): stderr: | [0;m[38;5;43m20221214124104223 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124104223 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5de6be8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124104223 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124104223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124104223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124104223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124104225 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124104226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124104226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124104226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:05.212788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23289): Terminating (SIGTERM) 12:41:05.254287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23292): Terminating (SIGTERM) 12:41:05.295794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23295): Terminating (SIGTERM) 12:41:05.337686 --- ParallelTerminationStrategy: PID 23289 died... 12:41:05.357591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23289): Terminated: ok {rc=0} 12:41:05.403623 --- ParallelTerminationStrategy: PID 23292 died... 12:41:05.423187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23292): Terminated: ok {rc=0} 12:41:05.468899 --- ParallelTerminationStrategy: PID 23295 died... 12:41:05.488333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23295): Terminated: ok {rc=0} 12:41:05.575505 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 12:41:06.788532 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:41:06.793937 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 12:41:06.812451 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 12:41:06.839982 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 12:41:06.866806 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 12:41:06.885721 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 12:41:06.912773 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 12:41:07.424516 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2404 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 12:41:07.429061 tst handover.py:11: TEST_CONFIG: {} 12:41:07.634515 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:41:07.650240 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:41:07.672940 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:41:07.723171 tst handover.py: using MSISDN 8693 12:41:07.835342 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8693', subscriber_id=0} 12:41:07.942142 run srsepc_10.42.42.118: Starting srsepc 12:41:09.785587 run rm-remote-dir(pid=23301): Launched 12:41:09.907540 bus /sierra_2: Setting Powered False 12:41:10.972927 run rm-remote-dir(pid=23301): Terminated: ok {rc=0} 12:41:11.416702 run mk-remote-dir(pid=23302): Launched 12:41:12.596150 run mk-remote-dir(pid=23302): Terminated: ok {rc=0} 12:41:12.889248 run scp-inst-to-remote(pid=23303): Launched 12:41:15.067713 run scp-inst-to-remote(pid=23303): Terminated: ok {rc=0} 12:41:15.403589 run rm-remote-dir(pid=23305): Launched 12:41:16.613653 run rm-remote-dir(pid=23305): Terminated: ok {rc=0} 12:41:17.016144 run mk-remote-dir(pid=23306): Launched 12:41:18.270463 run mk-remote-dir(pid=23306): Terminated: ok {rc=0} 12:41:18.570646 run scp-cfg-to-remote(pid=23307): Launched 12:41:19.748260 run scp-cfg-to-remote(pid=23307): Terminated: ok {rc=0} 12:41:20.034618 run scp-db-to-remote(pid=23309): Launched 12:41:21.211500 run scp-db-to-remote(pid=23309): Terminated: ok {rc=0} 12:41:21.343681 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:41:21.653916 run patchelf(pid=23311): Launched 12:41:22.830346 run patchelf(pid=23311): Terminated: ok {rc=0} 12:41:22.962955 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:41:23.275603 run setcap-netadm(pid=23312): Launched 12:41:24.453204 run setcap-netadm(pid=23312): Terminated: ok {rc=0} 12:41:24.779136 run srsepc(pid=23313): Launched 12:41:24.892688 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:41:25.997983 run rm-remote-dir(pid=23314): Launched 12:41:26.173879 run srsepc(pid=23313): ERR: Terminated: ERROR {rc=127} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23313)] 12:41:26.309840 run srsepc(pid=23313): stdout: | (launched: 2022-12-14_12:41:24.721967) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:41:26.445361 run srsepc(pid=23313): stderr: | (launched: 2022-12-14_12:41:24.767592) | Connection to 10.42.42.116 closed. 12:41:26.580560 run srsepc(pid=23313): stdout: | (launched: 2022-12-14_12:41:24.721967) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:41:26.710745 run srsepc(pid=23313): stderr: | (launched: 2022-12-14_12:41:24.767592) | Connection to 10.42.42.116 closed. 12:41:26.864640 run rm-remote-dir(pid=23314): Terminating (SIGINT) 12:41:27.043025 run rm-remote-dir(pid=23314): Terminated: ok {rc=0} 12:41:27.171812 tst handover.py:37: ERR: Error: srsepc(pid=23313): Process ended prematurely: srsepc(pid=23313) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23313)] [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 12:41:27.181884 tst handover.py:37: Test FAILED (19.7 sec) 12:41:27.260377 run scp-back-log(pid=23315): Launched 12:41:28.337636 run scp-back-log(pid=23315): ERR: Terminated: ERROR {rc=1} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23315)] 12:41:28.399371 run scp-back-log(pid=23315): stdout: | (launched: 2022-12-14_12:41:27.229167) 12:41:28.462606 run scp-back-log(pid=23315): stderr: | (launched: 2022-12-14_12:41:27.248903) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:41:28.533120 tst srsepc_10.42.42.118: Error('scp-back-log(pid=23315): launch_sync(): local process exited with status 1 [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23315)]') ---------------------------------------------- trial-2404 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 12:41:28.578085 tst iperf3_bidir.py:13: Number of physical ue: 1 12:41:28.785071 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:41:28.827886 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 12:41:29.032256 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:41:29.048017 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:41:29.079616 tst iperf3_bidir.py: using MSISDN 8694 12:41:29.191755 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8694', subscriber_id=0} 12:41:29.299003 run srsepc_10.42.42.118: Starting srsepc 12:41:29.928549 run rm-remote-dir(pid=23317): Launched 12:41:31.107972 run rm-remote-dir(pid=23317): Terminated: ok {rc=0} 12:41:31.456396 run mk-remote-dir(pid=23318): Launched 12:41:32.750011 run mk-remote-dir(pid=23318): Terminated: ok {rc=0} 12:41:33.038498 run scp-inst-to-remote(pid=23319): Launched 12:41:35.220793 run scp-inst-to-remote(pid=23319): Terminated: ok {rc=0} 12:41:35.578045 run rm-remote-dir(pid=23321): Launched 12:41:36.770678 run rm-remote-dir(pid=23321): Terminated: ok {rc=0} 12:41:37.129952 run mk-remote-dir(pid=23322): Launched 12:41:38.322344 run mk-remote-dir(pid=23322): Terminated: ok {rc=0} 12:41:38.631942 run scp-cfg-to-remote(pid=23323): Launched 12:41:39.813823 run scp-cfg-to-remote(pid=23323): Terminated: ok {rc=0} 12:41:40.100142 run scp-db-to-remote(pid=23325): Launched 12:41:41.276203 run scp-db-to-remote(pid=23325): Terminated: ok {rc=0} 12:41:41.407777 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:41:41.716542 run patchelf(pid=23327): Launched 12:41:42.891998 run patchelf(pid=23327): Terminated: ok {rc=0} 12:41:43.024287 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:41:43.332257 run setcap-netadm(pid=23328): Launched 12:41:44.507622 run setcap-netadm(pid=23328): Terminated: ok {rc=0} 12:41:44.832148 run srsepc(pid=23329): Launched 12:41:44.945200 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:41:46.143300 run rm-remote-dir(pid=23330): Launched 12:41:46.432640 run srsepc(pid=23329): ERR: Terminated: ERROR {rc=127} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23329)] 12:41:46.587730 run srsepc(pid=23329): stdout: | (launched: 2022-12-14_12:41:44.774960) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:41:46.728402 run srsepc(pid=23329): stderr: | (launched: 2022-12-14_12:41:44.820431) | Connection to 10.42.42.116 closed. 12:41:46.866351 run srsepc(pid=23329): stdout: | (launched: 2022-12-14_12:41:44.774960) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:41:47.001245 run srsepc(pid=23329): stderr: | (launched: 2022-12-14_12:41:44.820431) | Connection to 10.42.42.116 closed. 12:41:47.159295 run rm-remote-dir(pid=23330): Terminating (SIGINT) 12:41:47.343301 run rm-remote-dir(pid=23330): Terminated: ok {rc=0} 12:41:47.473433 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=23329): Process ended prematurely: srsepc(pid=23329) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23329)] [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 12:41:47.483806 tst iperf3_bidir.py:42: Test FAILED (18.9 sec) 12:41:47.563869 run scp-back-log(pid=23331): Launched 12:41:48.639020 run scp-back-log(pid=23331): ERR: Terminated: ERROR {rc=1} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23331)] 12:41:48.700012 run scp-back-log(pid=23331): stdout: | (launched: 2022-12-14_12:41:47.532472) 12:41:48.762297 run scp-back-log(pid=23331): stderr: | (launched: 2022-12-14_12:41:47.552401) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:41:48.832427 tst srsepc_10.42.42.118: Error('scp-back-log(pid=23331): launch_sync(): local process exited with status 1 [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23331)]') ---------------------------------------------- trial-2404 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 12:41:48.878068 tst iperf3_dl.py:13: Number of physical ue: 1 12:41:49.083963 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:41:49.128008 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 12:41:49.331016 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:41:49.346901 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:41:49.378059 tst iperf3_dl.py: using MSISDN 8695 12:41:49.491722 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8695', subscriber_id=0} 12:41:49.598681 run srsepc_10.42.42.118: Starting srsepc 12:41:50.227320 run rm-remote-dir(pid=23333): Launched 12:41:51.406359 run rm-remote-dir(pid=23333): Terminated: ok {rc=0} 12:41:51.739627 run mk-remote-dir(pid=23334): Launched 12:41:52.915422 run mk-remote-dir(pid=23334): Terminated: ok {rc=0} 12:41:53.199864 run scp-inst-to-remote(pid=23335): Launched 12:41:55.376475 run scp-inst-to-remote(pid=23335): Terminated: ok {rc=0} 12:41:55.708298 run rm-remote-dir(pid=23337): Launched 12:41:56.885766 run rm-remote-dir(pid=23337): Terminated: ok {rc=0} 12:41:57.219323 run mk-remote-dir(pid=23338): Launched 12:41:58.395231 run mk-remote-dir(pid=23338): Terminated: ok {rc=0} 12:41:58.681210 run scp-cfg-to-remote(pid=23339): Launched 12:41:59.856704 run scp-cfg-to-remote(pid=23339): Terminated: ok {rc=0} 12:42:00.139154 run scp-db-to-remote(pid=23341): Launched 12:42:01.316372 run scp-db-to-remote(pid=23341): Terminated: ok {rc=0} 12:42:01.460633 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:42:01.799556 run patchelf(pid=23347): Launched 12:42:03.045874 run patchelf(pid=23347): Terminated: ok {rc=0} 12:42:03.185598 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:42:03.495080 run setcap-netadm(pid=23348): Launched 12:42:04.669410 run setcap-netadm(pid=23348): Terminated: ok {rc=0} 12:42:04.991155 run srsepc(pid=23349): Launched 12:42:05.103481 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:42:06.269663 run rm-remote-dir(pid=23350): Launched 12:42:06.457917 run srsepc(pid=23349): ERR: Terminated: ERROR {rc=127} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23349)] 12:42:06.601700 run srsepc(pid=23349): stdout: | (launched: 2022-12-14_12:42:04.934348) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:42:06.745094 run srsepc(pid=23349): stderr: | (launched: 2022-12-14_12:42:04.979876) | Connection to 10.42.42.116 closed. 12:42:06.887863 run srsepc(pid=23349): stdout: | (launched: 2022-12-14_12:42:04.934348) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:42:07.025376 run srsepc(pid=23349): stderr: | (launched: 2022-12-14_12:42:04.979876) | Connection to 10.42.42.116 closed. 12:42:07.188378 run rm-remote-dir(pid=23350): Terminating (SIGINT) 12:42:07.376296 run rm-remote-dir(pid=23350): Terminated: ok {rc=0} 12:42:07.512315 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=23349): Process ended prematurely: srsepc(pid=23349) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23349)] [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 12:42:07.523070 tst iperf3_dl.py:42: Test FAILED (18.6 sec) 12:42:07.603901 run scp-back-log(pid=23351): Launched 12:42:08.684225 run scp-back-log(pid=23351): ERR: Terminated: ERROR {rc=1} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23351)] 12:42:08.747558 run scp-back-log(pid=23351): stdout: | (launched: 2022-12-14_12:42:07.571697) 12:42:08.812681 run scp-back-log(pid=23351): stderr: | (launched: 2022-12-14_12:42:07.592276) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:42:08.885649 tst srsepc_10.42.42.118: Error('scp-back-log(pid=23351): launch_sync(): local process exited with status 1 [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23351)]') ---------------------------------------------- trial-2404 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 12:42:08.932598 tst iperf3_ul.py:13: Number of physical ue: 1 12:42:09.151382 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:42:09.197094 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 12:42:09.416433 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:42:09.432909 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:42:09.464627 tst iperf3_ul.py: using MSISDN 8696 12:42:09.576135 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8696', subscriber_id=0} 12:42:09.681636 run srsepc_10.42.42.118: Starting srsepc 12:42:10.302180 run rm-remote-dir(pid=23353): Launched 12:42:11.479048 run rm-remote-dir(pid=23353): Terminated: ok {rc=0} 12:42:11.811720 run mk-remote-dir(pid=23354): Launched 12:42:12.987608 run mk-remote-dir(pid=23354): Terminated: ok {rc=0} 12:42:13.271387 run scp-inst-to-remote(pid=23355): Launched 12:42:15.449041 run scp-inst-to-remote(pid=23355): Terminated: ok {rc=0} 12:42:15.780101 run rm-remote-dir(pid=23357): Launched 12:42:16.973461 run rm-remote-dir(pid=23357): Terminated: ok {rc=0} 12:42:17.315401 run mk-remote-dir(pid=23358): Launched 12:42:18.491683 run mk-remote-dir(pid=23358): Terminated: ok {rc=0} 12:42:18.777251 run scp-cfg-to-remote(pid=23359): Launched 12:42:19.952865 run scp-cfg-to-remote(pid=23359): Terminated: ok {rc=0} 12:42:20.235492 run scp-db-to-remote(pid=23361): Launched 12:42:21.421248 run scp-db-to-remote(pid=23361): Terminated: ok {rc=0} 12:42:21.559664 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:42:21.885792 run patchelf(pid=23363): Launched 12:42:23.072873 run patchelf(pid=23363): Terminated: ok {rc=0} 12:42:23.211486 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:42:23.536692 run setcap-netadm(pid=23364): Launched 12:42:24.723118 run setcap-netadm(pid=23364): Terminated: ok {rc=0} 12:42:25.064059 run srsepc(pid=23366): Launched 12:42:25.184926 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:42:26.352272 run rm-remote-dir(pid=23367): Launched 12:42:26.539038 run srsepc(pid=23366): ERR: Terminated: ERROR {rc=127} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23366)] 12:42:26.682073 run srsepc(pid=23366): stdout: | (launched: 2022-12-14_12:42:25.005159) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:42:26.824360 run srsepc(pid=23366): stderr: | (launched: 2022-12-14_12:42:25.053079) | Connection to 10.42.42.116 closed. 12:42:26.966263 run srsepc(pid=23366): stdout: | (launched: 2022-12-14_12:42:25.005159) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:42:27.103228 run srsepc(pid=23366): stderr: | (launched: 2022-12-14_12:42:25.053079) | Connection to 10.42.42.116 closed. 12:42:27.265078 run rm-remote-dir(pid=23367): Terminating (SIGINT) 12:42:27.451670 run rm-remote-dir(pid=23367): Terminated: ok {rc=0} 12:42:27.586978 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=23366): Process ended prematurely: srsepc(pid=23366) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23366)] [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 12:42:27.597581 tst iperf3_ul.py:42: Test FAILED (18.7 sec) 12:42:27.677471 run scp-back-log(pid=23368): Launched 12:42:28.757611 run scp-back-log(pid=23368): ERR: Terminated: ERROR {rc=1} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23368)] 12:42:28.821201 run scp-back-log(pid=23368): stdout: | (launched: 2022-12-14_12:42:27.645802) 12:42:28.885995 run scp-back-log(pid=23368): stderr: | (launched: 2022-12-14_12:42:27.666646) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:42:28.959188 tst srsepc_10.42.42.118: Error('scp-back-log(pid=23368): launch_sync(): local process exited with status 1 [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23368)]') ---------------------------------------------- trial-2404 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 12:42:29.006655 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:42:29.023606 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:42:29.046966 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:42:29.096456 tst ping.py: using MSISDN 8697 12:42:29.216133 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8697', subscriber_id=0} 12:42:29.329176 run srsepc_10.42.42.118: Starting srsepc 12:42:29.992539 run rm-remote-dir(pid=23370): Launched 12:42:31.181398 run rm-remote-dir(pid=23370): Terminated: ok {rc=0} 12:42:31.547526 run mk-remote-dir(pid=23371): Launched 12:42:32.798029 run mk-remote-dir(pid=23371): Terminated: ok {rc=0} 12:42:33.098650 run scp-inst-to-remote(pid=23372): Launched 12:42:35.286142 run scp-inst-to-remote(pid=23372): Terminated: ok {rc=0} 12:42:35.636935 run rm-remote-dir(pid=23374): Launched 12:42:36.825848 run rm-remote-dir(pid=23374): Terminated: ok {rc=0} 12:42:37.178849 run mk-remote-dir(pid=23375): Launched 12:42:38.367048 run mk-remote-dir(pid=23375): Terminated: ok {rc=0} 12:42:38.667921 run scp-cfg-to-remote(pid=23376): Launched 12:42:39.854103 run scp-cfg-to-remote(pid=23376): Terminated: ok {rc=0} 12:42:40.153667 run scp-db-to-remote(pid=23378): Launched 12:42:41.340007 run scp-db-to-remote(pid=23378): Terminated: ok {rc=0} 12:42:41.477955 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:42:41.803040 run patchelf(pid=23380): Launched 12:42:42.989488 run patchelf(pid=23380): Terminated: ok {rc=0} 12:42:43.127849 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:42:43.451996 run setcap-netadm(pid=23381): Launched 12:42:44.638701 run setcap-netadm(pid=23381): Terminated: ok {rc=0} 12:42:44.980029 run srsepc(pid=23382): Launched 12:42:45.100641 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:42:46.275668 run rm-remote-dir(pid=23383): Launched 12:42:46.459248 run srsepc(pid=23382): ERR: Terminated: ERROR {rc=127} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23382)] 12:42:46.605476 run srsepc(pid=23382): stdout: | (launched: 2022-12-14_12:42:44.920814) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:42:46.770776 run srsepc(pid=23382): stderr: | (launched: 2022-12-14_12:42:44.968879) | Connection to 10.42.42.116 closed. 12:42:46.913625 run srsepc(pid=23382): stdout: | (launched: 2022-12-14_12:42:44.920814) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:42:47.045463 run srsepc(pid=23382): stderr: | (launched: 2022-12-14_12:42:44.968879) | Connection to 10.42.42.116 closed. 12:42:47.200748 run rm-remote-dir(pid=23383): Terminating (SIGINT) 12:42:47.380041 run rm-remote-dir(pid=23383): Terminated: ok {rc=0} 12:42:47.509886 tst ping.py:16: ERR: Error: srsepc(pid=23382): Process ended prematurely: srsepc(pid=23382) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23382)] [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 12:42:47.520168 tst ping.py:16: Test FAILED (18.5 sec) 12:42:47.597893 run scp-back-log(pid=23384): Launched 12:42:48.673154 run scp-back-log(pid=23384): ERR: Terminated: ERROR {rc=1} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23384)] 12:42:48.733583 run scp-back-log(pid=23384): stdout: | (launched: 2022-12-14_12:42:47.567645) 12:42:48.795408 run scp-back-log(pid=23384): stderr: | (launched: 2022-12-14_12:42:47.587436) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:42:48.864807 tst srsepc_10.42.42.118: Error('scp-back-log(pid=23384): launch_sync(): local process exited with status 1 [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23384)]') ---------------------------------------------- trial-2404 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 12:42:48.910441 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:42:48.927306 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:42:48.950182 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:42:49.000655 tst rrc_idle_mo_ping.py: using MSISDN 8698 12:42:49.112111 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8698', subscriber_id=0} 12:42:49.216401 run srsepc_10.42.42.118: Starting srsepc 12:42:49.831342 run rm-remote-dir(pid=23386): Launched 12:42:51.007267 run rm-remote-dir(pid=23386): Terminated: ok {rc=0} 12:42:51.337317 run mk-remote-dir(pid=23387): Launched 12:42:52.512393 run mk-remote-dir(pid=23387): Terminated: ok {rc=0} 12:42:52.794121 run scp-inst-to-remote(pid=23388): Launched 12:42:54.969641 run scp-inst-to-remote(pid=23388): Terminated: ok {rc=0} 12:42:55.298224 run rm-remote-dir(pid=23390): Launched 12:42:56.474007 run rm-remote-dir(pid=23390): Terminated: ok {rc=0} 12:42:56.803950 run mk-remote-dir(pid=23391): Launched 12:42:57.979065 run mk-remote-dir(pid=23391): Terminated: ok {rc=0} 12:42:58.261686 run scp-cfg-to-remote(pid=23392): Launched 12:42:59.434945 run scp-cfg-to-remote(pid=23392): Terminated: ok {rc=0} 12:42:59.715016 run scp-db-to-remote(pid=23394): Launched 12:43:00.907162 run scp-db-to-remote(pid=23394): Terminated: ok {rc=0} 12:43:01.078331 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:43:01.392897 run patchelf(pid=23396): Launched 12:43:02.626109 run patchelf(pid=23396): Terminated: ok {rc=0} 12:43:02.766536 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:43:03.091404 run setcap-netadm(pid=23397): Launched 12:43:04.278155 run setcap-netadm(pid=23397): Terminated: ok {rc=0} 12:43:04.621873 run srsepc(pid=23398): Launched 12:43:04.743121 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:43:05.910192 run rm-remote-dir(pid=23399): Launched 12:43:06.097011 run srsepc(pid=23398): ERR: Terminated: ERROR {rc=127} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23398)] 12:43:06.239403 run srsepc(pid=23398): stdout: | (launched: 2022-12-14_12:43:04.562957) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:43:06.381365 run srsepc(pid=23398): stderr: | (launched: 2022-12-14_12:43:04.610932) | Connection to 10.42.42.116 closed. 12:43:06.523222 run srsepc(pid=23398): stdout: | (launched: 2022-12-14_12:43:04.562957) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:43:06.659586 run srsepc(pid=23398): stderr: | (launched: 2022-12-14_12:43:04.610932) | Connection to 10.42.42.116 closed. 12:43:06.821652 run rm-remote-dir(pid=23399): Terminating (SIGINT) 12:43:07.008236 run rm-remote-dir(pid=23399): Terminated: ok {rc=0} 12:43:07.143379 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=23398): Process ended prematurely: srsepc(pid=23398) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23398)] [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 12:43:07.154110 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 12:43:07.234270 run scp-back-log(pid=23400): Launched 12:43:08.313817 run scp-back-log(pid=23400): ERR: Terminated: ERROR {rc=1} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23400)] 12:43:08.376206 run scp-back-log(pid=23400): stdout: | (launched: 2022-12-14_12:43:07.202285) 12:43:08.440171 run scp-back-log(pid=23400): stderr: | (launched: 2022-12-14_12:43:07.222841) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:43:08.512842 tst srsepc_10.42.42.118: Error('scp-back-log(pid=23400): launch_sync(): local process exited with status 1 [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23400)]') ---------------------------------------------- trial-2404 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 12:43:08.560262 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:43:08.577472 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:43:08.600662 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:43:08.650489 tst rrc_idle_mt_ping.py: using MSISDN 8699 12:43:08.763053 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8699', subscriber_id=0} 12:43:08.868397 run srsepc_10.42.42.118: Starting srsepc 12:43:09.487630 run rm-remote-dir(pid=23402): Launched 12:43:10.665164 run rm-remote-dir(pid=23402): Terminated: ok {rc=0} 12:43:10.996074 run mk-remote-dir(pid=23403): Launched 12:43:12.171810 run mk-remote-dir(pid=23403): Terminated: ok {rc=0} 12:43:12.453896 run scp-inst-to-remote(pid=23404): Launched 12:43:14.628361 run scp-inst-to-remote(pid=23404): Terminated: ok {rc=0} 12:43:14.957474 run rm-remote-dir(pid=23406): Launched 12:43:16.142877 run rm-remote-dir(pid=23406): Terminated: ok {rc=0} 12:43:16.514681 run mk-remote-dir(pid=23407): Launched 12:43:17.756294 run mk-remote-dir(pid=23407): Terminated: ok {rc=0} 12:43:18.038567 run scp-cfg-to-remote(pid=23408): Launched 12:43:19.212649 run scp-cfg-to-remote(pid=23408): Terminated: ok {rc=0} 12:43:19.493031 run scp-db-to-remote(pid=23410): Launched 12:43:20.665883 run scp-db-to-remote(pid=23410): Terminated: ok {rc=0} 12:43:20.795309 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:43:21.099073 run patchelf(pid=23412): Launched 12:43:22.273558 run patchelf(pid=23412): Terminated: ok {rc=0} 12:43:22.404011 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:43:22.707931 run setcap-netadm(pid=23413): Launched 12:43:23.880768 run setcap-netadm(pid=23413): Terminated: ok {rc=0} 12:43:24.199572 run srsepc(pid=23414): Launched 12:43:24.311582 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:43:25.401268 run rm-remote-dir(pid=23415): Launched 12:43:25.574140 run srsepc(pid=23414): ERR: Terminated: ERROR {rc=127} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23414)] 12:43:25.706499 run srsepc(pid=23414): stdout: | (launched: 2022-12-14_12:43:24.144268) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:43:25.839959 run srsepc(pid=23414): stderr: | (launched: 2022-12-14_12:43:24.189121) | Connection to 10.42.42.116 closed. 12:43:25.972784 run srsepc(pid=23414): stdout: | (launched: 2022-12-14_12:43:24.144268) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:43:26.100636 run srsepc(pid=23414): stderr: | (launched: 2022-12-14_12:43:24.189121) | Connection to 10.42.42.116 closed. 12:43:26.251933 run rm-remote-dir(pid=23415): Terminating (SIGINT) 12:43:26.426821 run rm-remote-dir(pid=23415): Terminated: ok {rc=0} 12:43:26.553613 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=23414): Process ended prematurely: srsepc(pid=23414) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23414)] [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 12:43:26.563550 tst rrc_idle_mt_ping.py:16: Test FAILED (18.0 sec) 12:43:26.640410 run scp-back-log(pid=23416): Launched 12:43:27.718304 run scp-back-log(pid=23416): ERR: Terminated: ERROR {rc=1} [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23416)] 12:43:27.782293 run scp-back-log(pid=23416): stdout: | (launched: 2022-12-14_12:43:26.610216) 12:43:27.848213 run scp-back-log(pid=23416): stderr: | (launched: 2022-12-14_12:43:26.629914) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:43:27.921700 tst srsepc_10.42.42.118: Error('scp-back-log(pid=23416): launch_sync(): local process exited with status 1 [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=23416)]') --------------------------------------------------------------------- trial-2404 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 12:43:28.058366 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:43:28.064321 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 12:43:28.106763 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 12:43:28.133878 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 12:43:28.183852 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 12:43:28.227280 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 12:43:28.254202 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 12:43:28.805562 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 12:43:28.811196 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:43:28.822545 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 12:43:28.860182 tst handover.py: using LAC 40968 12:43:28.979146 tst handover.py: using RAC 168 12:43:29.094150 tst handover.py: using CellId 40968 12:43:29.209297 tst handover.py: using BVCI 40969 12:43:29.325817 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 12:43:29.359671 tst handover.py: using LAC 40969 12:43:29.482201 tst handover.py: using RAC 169 12:43:29.605593 tst handover.py: using CellId 40969 12:43:29.729207 tst handover.py: using BVCI 40970 12:43:29.846534 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:43:29.857839 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:43:29.868861 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:43:29.879860 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:43:29.891190 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:43:29.902366 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 12:43:30.018564 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 12:43:30.132506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:43:30.591293 run create_hlr_db(pid=23422): Launched 12:43:31.765760 run create_hlr_db(pid=23422): Terminated: ok {rc=0} 12:43:32.103185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23424): Launched 12:43:32.417511 run osmo-hlr_10.42.42.2(pid=23425): Launched 12:43:32.530651 run osmo-stp_10.42.42.5: Starting osmo-stp 12:43:33.041702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23427): Launched 12:43:33.340043 run osmo-stp_10.42.42.5(pid=23428): Launched 12:43:33.453837 run osmo-msc_10.42.42.6: Starting osmo-msc 12:43:33.992825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23430): Launched 12:43:34.290612 run osmo-msc_10.42.42.6(pid=23431): Launched 12:43:34.457400 run osmo-stp_10.42.42.5(pid=23428): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23428)] 12:43:34.589436 run osmo-stp_10.42.42.5(pid=23428): stdout: | (launched: 2022-12-14_12:43:33.285297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:34.716859 run osmo-stp_10.42.42.5(pid=23428): stderr: | [0;m[38;5;43m20221214124333456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124333456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124333456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124333457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124333457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124333457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124333457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:34.840780 run osmo-stp_10.42.42.5(pid=23428): stdout: | (launched: 2022-12-14_12:43:33.285297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:34.958574 run osmo-stp_10.42.42.5(pid=23428): stderr: | [0;m[38;5;43m20221214124333456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124333456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124333456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124333457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124333457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124333457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124333457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:35.099620 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23428): Process ended prematurely: osmo-stp_10.42.42.5(pid=23428) [trial-2404↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23428)] [trial-2404↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 12:43:35.107957 tst handover.py:18: Test FAILED (6.3 sec) 12:43:35.134218 run osmo-hlr_10.42.42.2(pid=23425): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23425)] 12:43:35.182133 run osmo-hlr_10.42.42.2(pid=23425): stdout: | (launched: 2022-12-14_12:43:32.362870) 12:43:35.231121 run osmo-hlr_10.42.42.2(pid=23425): stderr: | [0;m[1;31m20221214124332540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124332540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124332540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124332540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124332540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124332540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124332579 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124332589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124332589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124332589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:43:35.300560 run osmo-msc_10.42.42.6(pid=23431): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23431)] 12:43:35.347540 run osmo-msc_10.42.42.6(pid=23431): stdout: | (launched: 2022-12-14_12:43:34.234999) 12:43:35.396434 run osmo-msc_10.42.42.6(pid=23431): stderr: | [0;m[38;5;43m20221214124334512 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124334523 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30ff33ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124334523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124334523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124334524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124334524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124334538 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124334538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124334539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124334539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:43:35.445450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23424): Terminating (SIGTERM) 12:43:35.485097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23427): Terminating (SIGTERM) 12:43:35.524718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23430): Terminating (SIGTERM) 12:43:35.564537 --- ParallelTerminationStrategy: PID 23424 died... 12:43:35.583680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23424): Terminated: ok {rc=0} 12:43:35.627431 --- ParallelTerminationStrategy: PID 23427 died... 12:43:35.646005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23427): Terminated: ok {rc=0} 12:43:35.689402 --- ParallelTerminationStrategy: PID 23430 died... 12:43:35.707823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23430): Terminated: ok {rc=0} 12:43:35.791286 bus /sierra_3: Setting Powered False 12:43:36.889067 bus /sierra_3: Setting Powered False 12:43:38.006157 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 12:43:39.247964 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:43:39.252911 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 12:43:39.293536 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 12:43:39.320713 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 12:43:39.373271 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 12:43:39.413590 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 12:43:39.440769 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 12:43:39.998770 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 12:43:40.004855 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:43:40.016127 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 12:43:40.053834 tst handover.py: using LAC 40970 12:43:40.178497 tst handover.py: using RAC 170 12:43:40.301814 tst handover.py: using CellId 40970 12:43:40.425270 tst handover.py: using BVCI 40971 12:43:40.540882 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 12:43:40.574448 tst handover.py: using LAC 40971 12:43:40.699871 tst handover.py: using RAC 171 12:43:40.823611 tst handover.py: using CellId 40971 12:43:40.946726 tst handover.py: using BVCI 40972 12:43:41.062316 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:43:41.073511 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:43:41.084437 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:43:41.095406 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:43:41.107134 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:43:41.118646 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 12:43:41.234151 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 12:43:41.351602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:43:41.817308 run create_hlr_db(pid=23436): Launched 12:43:41.938451 bus /sierra_2: Setting Powered False 12:43:43.001274 run create_hlr_db(pid=23436): Terminated: ok {rc=0} 12:43:43.418355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23438): Launched 12:43:43.736661 run osmo-hlr_10.42.42.2(pid=23439): Launched 12:43:43.858804 run osmo-stp_10.42.42.5: Starting osmo-stp 12:43:44.383916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23441): Launched 12:43:44.703040 run osmo-stp_10.42.42.5(pid=23442): Launched 12:43:44.825060 run osmo-msc_10.42.42.6: Starting osmo-msc 12:43:45.375675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23444): Launched 12:43:45.695146 run osmo-msc_10.42.42.6(pid=23445): Launched 12:43:45.912927 run osmo-stp_10.42.42.5(pid=23442): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23442)] 12:43:46.096689 run osmo-stp_10.42.42.5(pid=23442): stdout: | (launched: 2022-12-14_12:43:44.644662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:46.367964 run osmo-stp_10.42.42.5(pid=23442): stderr: | [0;m[38;5;43m20221214124344837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124344837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124344838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124344838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124344839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124344839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124344839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:46.532027 run osmo-stp_10.42.42.5(pid=23442): stdout: | (launched: 2022-12-14_12:43:44.644662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:46.661503 run osmo-stp_10.42.42.5(pid=23442): stderr: | [0;m[38;5;43m20221214124344837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124344837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124344838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124344838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124344839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124344839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124344839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:46.819579 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23442): Process ended prematurely: osmo-stp_10.42.42.5(pid=23442) [trial-2404↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23442)] [trial-2404↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 12:43:46.829084 tst handover.py:18: Test FAILED (6.8 sec) 12:43:46.856708 run osmo-hlr_10.42.42.2(pid=23439): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23439)] 12:43:46.907456 run osmo-hlr_10.42.42.2(pid=23439): stdout: | (launched: 2022-12-14_12:43:43.678046) 12:43:46.959850 run osmo-hlr_10.42.42.2(pid=23439): stderr: | [0;m[1;31m20221214124343876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124343876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124343877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124343877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124343877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124343877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124343889 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124343897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124343898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124343898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:43:47.033623 run osmo-msc_10.42.42.6(pid=23445): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23445)] 12:43:47.084620 run osmo-msc_10.42.42.6(pid=23445): stdout: | (launched: 2022-12-14_12:43:45.636702) 12:43:47.137274 run osmo-msc_10.42.42.6(pid=23445): stderr: | [0;m[38;5;43m20221214124346096 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124346097 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b16f38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124346097 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124346097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124346097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124346098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124346099 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124346100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124346100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124346100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:43:47.190250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23438): Terminating (SIGTERM) 12:43:47.233003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23441): Terminating (SIGTERM) 12:43:47.275221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23444): Terminating (SIGTERM) 12:43:47.318927 --- ParallelTerminationStrategy: PID 23438 died... 12:43:47.338924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23438): Terminated: ok {rc=0} 12:43:47.386222 --- ParallelTerminationStrategy: PID 23441 died... 12:43:47.405889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23441): Terminated: ok {rc=0} 12:43:47.452034 --- ParallelTerminationStrategy: PID 23444 died... 12:43:47.471637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23444): Terminated: ok {rc=0} 12:43:47.559461 bus /sierra_3: Setting Powered False 12:43:48.657855 bus /sierra_3: Setting Powered False 12:43:49.774906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 12:43:51.015287 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:43:51.020167 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:43:51.073241 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:43:51.099367 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:43:51.151137 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:43:51.206080 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:43:51.233001 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:43:51.779454 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 12:43:51.785540 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:43:51.796754 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:43:51.840129 tst handover.py: using LAC 40972 12:43:51.957695 tst handover.py: using RAC 172 12:43:52.073631 tst handover.py: using CellId 40972 12:43:52.199581 tst handover.py: using BVCI 40973 12:43:52.315360 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:43:52.363914 tst handover.py: using LAC 40973 12:43:52.490765 tst handover.py: using RAC 173 12:43:52.616280 tst handover.py: using CellId 40973 12:43:52.739448 tst handover.py: using BVCI 40974 12:43:52.855041 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:43:52.866264 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:43:52.877231 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:43:52.888229 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:43:52.899318 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:43:52.910356 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:43:53.025947 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:43:53.140157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:43:53.607519 run create_hlr_db(pid=23451): Launched 12:43:53.728910 bus /sierra_2: Setting Powered False 12:43:54.792177 run create_hlr_db(pid=23451): Terminated: ok {rc=0} 12:43:55.209757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23453): Launched 12:43:55.529262 run osmo-hlr_10.42.42.2(pid=23454): Launched 12:43:55.650952 run osmo-stp_10.42.42.5: Starting osmo-stp 12:43:56.177738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23456): Launched 12:43:56.495529 run osmo-stp_10.42.42.5(pid=23457): Launched 12:43:56.617462 run osmo-msc_10.42.42.6: Starting osmo-msc 12:43:57.167250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23459): Launched 12:43:57.487122 run osmo-msc_10.42.42.6(pid=23460): Launched 12:43:57.665992 run osmo-stp_10.42.42.5(pid=23457): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23457)] 12:43:57.801700 run osmo-stp_10.42.42.5(pid=23457): stdout: | (launched: 2022-12-14_12:43:56.437358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:57.937487 run osmo-stp_10.42.42.5(pid=23457): stderr: | [0;m[38;5;43m20221214124356629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124356629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124356629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124356630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124356630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124356630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124356630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:58.071786 run osmo-stp_10.42.42.5(pid=23457): stdout: | (launched: 2022-12-14_12:43:56.437358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:58.199012 run osmo-stp_10.42.42.5(pid=23457): stderr: | [0;m[38;5;43m20221214124356629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124356629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124356629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124356630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124356630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124356630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124356630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:58.351399 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23457): Process ended prematurely: osmo-stp_10.42.42.5(pid=23457) [trial-2404↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23457)] [trial-2404↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 12:43:58.360323 tst handover.py:18: Test FAILED (6.6 sec) 12:43:58.387663 run osmo-hlr_10.42.42.2(pid=23454): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23454)] 12:43:58.437717 run osmo-hlr_10.42.42.2(pid=23454): stdout: | (launched: 2022-12-14_12:43:55.470839) 12:43:58.489442 run osmo-hlr_10.42.42.2(pid=23454): stderr: | [0;m[1;31m20221214124355669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124355669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124355669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124355669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124355669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124355669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124355682 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124355692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124355692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124355692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:43:58.561398 run osmo-msc_10.42.42.6(pid=23460): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23460)] 12:43:58.611037 run osmo-msc_10.42.42.6(pid=23460): stdout: | (launched: 2022-12-14_12:43:57.428435) 12:43:58.662188 run osmo-msc_10.42.42.6(pid=23460): stderr: | [0;m[38;5;43m20221214124357749 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124357749 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f107a7abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124357749 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124357749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124357749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124357750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124357751 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124357752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124357752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124357752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:43:58.714253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23453): Terminating (SIGTERM) 12:43:58.756078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23456): Terminating (SIGTERM) 12:43:58.798148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23459): Terminating (SIGTERM) 12:43:58.839868 --- ParallelTerminationStrategy: PID 23453 died... 12:43:58.859825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23453): Terminated: ok {rc=0} 12:43:58.905741 --- ParallelTerminationStrategy: PID 23456 died... 12:43:58.925322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23456): Terminated: ok {rc=0} 12:43:58.971037 --- ParallelTerminationStrategy: PID 23459 died... 12:43:58.990614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23459): Terminated: ok {rc=0} 12:43:59.077696 bus /sierra_3: Setting Powered False 12:44:00.175588 bus /sierra_3: Setting Powered False 12:44:01.306863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:44:02.584455 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:02.590145 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:44:02.640211 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:44:02.667128 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:44:02.719218 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:44:02.769378 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:44:02.795716 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:44:03.350676 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:44:03.357168 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:44:03.369140 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:44:03.407461 tst handover.py: using LAC 40974 12:44:03.532423 tst handover.py: using RAC 174 12:44:03.661568 tst handover.py: using CellId 40974 12:44:03.786579 tst handover.py: using BVCI 40975 12:44:03.901675 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:44:03.945262 tst handover.py: using LAC 40975 12:44:04.068704 tst handover.py: using RAC 175 12:44:04.192277 tst handover.py: using CellId 40975 12:44:04.315047 tst handover.py: using BVCI 40976 12:44:04.432167 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:44:04.443685 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:44:04.454933 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:44:04.466243 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:44:04.478090 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:44:04.490150 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:44:04.609943 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:44:04.726752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:05.161149 run create_hlr_db(pid=23467): Launched 12:44:05.282805 bus /sierra_2: Setting Powered False 12:44:06.341497 run create_hlr_db(pid=23467): Terminated: ok {rc=0} 12:44:06.751968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23469): Launched 12:44:07.069761 run osmo-hlr_10.42.42.2(pid=23470): Launched 12:44:07.191830 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:07.716027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23472): Launched 12:44:08.034147 run osmo-stp_10.42.42.5(pid=23473): Launched 12:44:08.155613 run osmo-msc_10.42.42.6: Starting osmo-msc 12:44:08.708726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23475): Launched 12:44:09.028043 run osmo-msc_10.42.42.6(pid=23476): Launched 12:44:09.205390 run osmo-stp_10.42.42.5(pid=23473): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23473)] 12:44:09.339786 run osmo-stp_10.42.42.5(pid=23473): stdout: | (launched: 2022-12-14_12:44:07.976040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:09.474415 run osmo-stp_10.42.42.5(pid=23473): stderr: | [0;m[38;5;43m20221214124408170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124408170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124408170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124408171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124408171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124408171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124408171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:09.609207 run osmo-stp_10.42.42.5(pid=23473): stdout: | (launched: 2022-12-14_12:44:07.976040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:09.736729 run osmo-stp_10.42.42.5(pid=23473): stderr: | [0;m[38;5;43m20221214124408170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124408170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124408170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124408171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124408171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124408171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124408171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:09.888815 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23473): Process ended prematurely: osmo-stp_10.42.42.5(pid=23473) [trial-2404↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23473)] [trial-2404↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 12:44:09.897928 tst handover.py:18: Test FAILED (6.5 sec) 12:44:09.925154 run osmo-hlr_10.42.42.2(pid=23470): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23470)] 12:44:09.974597 run osmo-hlr_10.42.42.2(pid=23470): stdout: | (launched: 2022-12-14_12:44:07.011738) 12:44:10.025763 run osmo-hlr_10.42.42.2(pid=23470): stderr: | [0;m[1;31m20221214124407209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124407209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124407209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124407209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124407209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124407209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124407222 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124407232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124407232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124407233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:10.096728 run osmo-msc_10.42.42.6(pid=23476): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23476)] 12:44:10.145905 run osmo-msc_10.42.42.6(pid=23476): stdout: | (launched: 2022-12-14_12:44:08.969635) 12:44:10.196825 run osmo-msc_10.42.42.6(pid=23476): stderr: | [0;m[38;5;43m20221214124409292 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124409292 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2708cbdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124409293 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124409293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124409293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124409293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124409295 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124409295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124409295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124409295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:44:10.248133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23469): Terminating (SIGTERM) 12:44:10.289249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23472): Terminating (SIGTERM) 12:44:10.330655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23475): Terminating (SIGTERM) 12:44:10.372706 --- ParallelTerminationStrategy: PID 23469 died... 12:44:10.392572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23469): Terminated: ok {rc=0} 12:44:10.438299 --- ParallelTerminationStrategy: PID 23472 died... 12:44:10.457798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23472): Terminated: ok {rc=0} 12:44:10.503328 --- ParallelTerminationStrategy: PID 23475 died... 12:44:10.522723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23475): Terminated: ok {rc=0} 12:44:10.610033 bus /sierra_3: Setting Powered False 12:44:11.708787 bus /sierra_3: Setting Powered False 12:44:12.823737 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:44:14.084315 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:14.089850 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:44:14.144337 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:44:14.171289 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:44:14.222762 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:44:14.277478 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:44:14.304170 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:44:14.858782 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:44:14.864238 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:44:14.875705 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:44:14.913090 tst handover.py: using LAC 40976 12:44:15.037925 tst handover.py: using RAC 176 12:44:15.163757 tst handover.py: using CellId 40976 12:44:15.287802 tst handover.py: using BVCI 40977 12:44:15.403139 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:44:15.453668 tst handover.py: using LAC 40977 12:44:15.580254 tst handover.py: using RAC 177 12:44:15.707039 tst handover.py: using CellId 40977 12:44:15.842506 tst handover.py: using BVCI 40978 12:44:15.967830 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:44:15.979897 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:44:15.991692 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:44:16.003790 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:44:16.016058 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:44:16.028441 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:44:16.154072 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:44:16.283016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:16.786089 run create_hlr_db(pid=23482): Launched 12:44:16.941209 bus /sierra_2: Setting Powered False 12:44:18.004366 run create_hlr_db(pid=23482): Terminated: ok {rc=0} 12:44:18.422293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23484): Launched 12:44:18.740817 run osmo-hlr_10.42.42.2(pid=23485): Launched 12:44:18.862621 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:19.383826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23487): Launched 12:44:19.703181 run osmo-stp_10.42.42.5(pid=23488): Launched 12:44:19.824914 run osmo-msc_10.42.42.6: Starting osmo-msc 12:44:20.374161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23490): Launched 12:44:20.691729 run osmo-msc_10.42.42.6(pid=23491): Launched 12:44:20.868204 run osmo-stp_10.42.42.5(pid=23488): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23488)] 12:44:21.002556 run osmo-stp_10.42.42.5(pid=23488): stdout: | (launched: 2022-12-14_12:44:19.644520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:21.136342 run osmo-stp_10.42.42.5(pid=23488): stderr: | [0;m[38;5;43m20221214124419836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124419836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124419836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124419836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124419839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124419839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124419839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:21.269964 run osmo-stp_10.42.42.5(pid=23488): stdout: | (launched: 2022-12-14_12:44:19.644520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:21.396443 run osmo-stp_10.42.42.5(pid=23488): stderr: | [0;m[38;5;43m20221214124419836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124419836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124419836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124419836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124419839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124419839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124419839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:21.547996 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23488): Process ended prematurely: osmo-stp_10.42.42.5(pid=23488) [trial-2404↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23488)] [trial-2404↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 12:44:21.556748 tst handover.py:18: Test FAILED (6.7 sec) 12:44:21.583744 run osmo-hlr_10.42.42.2(pid=23485): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23485)] 12:44:21.633384 run osmo-hlr_10.42.42.2(pid=23485): stdout: | (launched: 2022-12-14_12:44:18.682199) 12:44:21.685174 run osmo-hlr_10.42.42.2(pid=23485): stderr: | [0;m[1;31m20221214124418881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124418881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124418881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124418881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124418881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124418881 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124418893 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124418901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124418902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124418902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:21.756857 run osmo-msc_10.42.42.6(pid=23491): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23491)] 12:44:21.806343 run osmo-msc_10.42.42.6(pid=23491): stdout: | (launched: 2022-12-14_12:44:20.633734) 12:44:21.857343 run osmo-msc_10.42.42.6(pid=23491): stderr: | [0;m[38;5;43m20221214124420956 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124420957 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb129b9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124420957 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124420957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124420957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124420957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124420959 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124420959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124420959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124420959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:44:21.909123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23484): Terminating (SIGTERM) 12:44:21.950423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23487): Terminating (SIGTERM) 12:44:21.991739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23490): Terminating (SIGTERM) 12:44:22.033298 --- ParallelTerminationStrategy: PID 23484 died... 12:44:22.053201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23484): Terminated: ok {rc=0} 12:44:22.098869 --- ParallelTerminationStrategy: PID 23487 died... 12:44:22.118198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23487): Terminated: ok {rc=0} 12:44:22.163710 --- ParallelTerminationStrategy: PID 23490 died... 12:44:22.183014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23490): Terminated: ok {rc=0} 12:44:22.270342 bus /sierra_3: Setting Powered False 12:44:23.368362 bus /sierra_3: Setting Powered False 12:44:24.485291 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 12:44:25.747036 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:25.751829 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:44:25.793246 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:44:25.819839 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:44:25.874663 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:44:25.917735 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:44:25.944613 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:44:26.489970 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 12:44:26.496218 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:44:26.507829 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 12:44:26.544259 tst handover.py: using LAC 40978 12:44:26.661905 tst handover.py: using RAC 178 12:44:26.778633 tst handover.py: using CellId 40978 12:44:26.893540 tst handover.py: using BVCI 40979 12:44:27.002878 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 12:44:27.036049 tst handover.py: using LAC 40979 12:44:27.151384 tst handover.py: using RAC 179 12:44:27.266675 tst handover.py: using CellId 40979 12:44:27.381063 tst handover.py: using BVCI 40980 12:44:27.488166 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:44:27.498916 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:44:27.509489 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:44:27.519880 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:44:27.530795 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:44:27.541741 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 12:44:27.660891 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 12:44:27.777991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:28.212417 run create_hlr_db(pid=23496): Launched 12:44:28.325475 bus /sierra_2: Setting Powered False 12:44:29.384170 run create_hlr_db(pid=23496): Terminated: ok {rc=0} 12:44:29.794167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23498): Launched 12:44:30.112400 run osmo-hlr_10.42.42.2(pid=23499): Launched 12:44:30.233200 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:30.753653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23501): Launched 12:44:31.073736 run osmo-stp_10.42.42.5(pid=23502): Launched 12:44:31.350824 run osmo-msc_10.42.42.6: Starting osmo-msc 12:44:31.905762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23504): Launched 12:44:32.227118 run osmo-msc_10.42.42.6(pid=23505): Launched 12:44:32.398040 run osmo-stp_10.42.42.5(pid=23502): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23502)] 12:44:32.527157 run osmo-stp_10.42.42.5(pid=23502): stdout: | (launched: 2022-12-14_12:44:31.011923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:32.656581 run osmo-stp_10.42.42.5(pid=23502): stderr: | [0;m[38;5;43m20221214124431238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124431238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124431238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124431239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:32.783046 run osmo-stp_10.42.42.5(pid=23502): stdout: | (launched: 2022-12-14_12:44:31.011923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:32.902942 run osmo-stp_10.42.42.5(pid=23502): stderr: | [0;m[38;5;43m20221214124431238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124431238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124431238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124431239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124431239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:33.045838 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23502): Process ended prematurely: osmo-stp_10.42.42.5(pid=23502) [trial-2404↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23502)] [trial-2404↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 12:44:33.054319 tst handover.py:18: Test FAILED (6.6 sec) 12:44:33.080378 run osmo-hlr_10.42.42.2(pid=23499): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23499)] 12:44:33.129860 run osmo-hlr_10.42.42.2(pid=23499): stdout: | (launched: 2022-12-14_12:44:30.054572) 12:44:33.180026 run osmo-hlr_10.42.42.2(pid=23499): stderr: | [0;m[1;31m20221214124430252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124430252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124430252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124430253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124430253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124430253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124430265 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124430274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124430274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124430274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:33.250301 run osmo-msc_10.42.42.6(pid=23505): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23505)] 12:44:33.297510 run osmo-msc_10.42.42.6(pid=23505): stdout: | (launched: 2022-12-14_12:44:32.165858) 12:44:33.347307 run osmo-msc_10.42.42.6(pid=23505): stderr: | [0;m[38;5;43m20221214124432480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124432480 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd2dff8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124432480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124432480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124432480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124432481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124432482 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124432483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124432483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124432483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:44:33.397621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23498): Terminating (SIGTERM) 12:44:33.438033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23501): Terminating (SIGTERM) 12:44:33.478512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23504): Terminating (SIGTERM) 12:44:33.519269 --- ParallelTerminationStrategy: PID 23498 died... 12:44:33.539100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23498): Terminated: ok {rc=0} 12:44:33.583640 --- ParallelTerminationStrategy: PID 23501 died... 12:44:33.603069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23501): Terminated: ok {rc=0} 12:44:33.647288 --- ParallelTerminationStrategy: PID 23504 died... 12:44:33.666809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23504): Terminated: ok {rc=0} 12:44:33.753191 bus /sierra_3: Setting Powered False 12:44:34.852244 bus /sierra_3: Setting Powered False 12:44:35.966788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 12:44:37.209947 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:37.214844 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:44:37.267401 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:44:37.293502 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:44:37.345477 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:44:37.400327 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:44:37.427222 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:44:37.974187 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 12:44:37.980273 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:44:37.991524 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:44:38.028705 tst handover.py: using LAC 40980 12:44:38.145367 tst handover.py: using RAC 180 12:44:38.262269 tst handover.py: using CellId 40980 12:44:38.378288 tst handover.py: using BVCI 40981 12:44:38.487761 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:44:38.534887 tst handover.py: using LAC 40981 12:44:38.653195 tst handover.py: using RAC 181 12:44:38.769608 tst handover.py: using CellId 40981 12:44:38.886204 tst handover.py: using BVCI 40982 12:44:38.995890 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:44:39.006810 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:44:39.017687 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:44:39.028363 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:44:39.039678 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:44:39.050744 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:44:39.169777 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:44:39.286371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:39.721455 run create_hlr_db(pid=23510): Launched 12:44:39.834411 bus /sierra_2: Setting Powered False 12:44:40.893447 run create_hlr_db(pid=23510): Terminated: ok {rc=0} 12:44:41.302972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23512): Launched 12:44:41.623371 run osmo-hlr_10.42.42.2(pid=23513): Launched 12:44:41.745377 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:42.267009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23515): Launched 12:44:42.584705 run osmo-stp_10.42.42.5(pid=23516): Launched 12:44:42.706269 run osmo-msc_10.42.42.6: Starting osmo-msc 12:44:43.258822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23518): Launched 12:44:43.577329 run osmo-msc_10.42.42.6(pid=23519): Launched 12:44:43.754978 run osmo-stp_10.42.42.5(pid=23516): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23516)] 12:44:43.890246 run osmo-stp_10.42.42.5(pid=23516): stdout: | (launched: 2022-12-14_12:44:42.526479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:44.025470 run osmo-stp_10.42.42.5(pid=23516): stderr: | [0;m[38;5;43m20221214124442718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124442718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124442718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124442718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124442721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124442721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124442721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:44.159355 run osmo-stp_10.42.42.5(pid=23516): stdout: | (launched: 2022-12-14_12:44:42.526479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:44.286106 run osmo-stp_10.42.42.5(pid=23516): stderr: | [0;m[38;5;43m20221214124442718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124442718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124442718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124442718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124442721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124442721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124442721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:44.438040 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23516): Process ended prematurely: osmo-stp_10.42.42.5(pid=23516) [trial-2404↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23516)] [trial-2404↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 12:44:44.446915 tst handover.py:18: Test FAILED (6.5 sec) 12:44:44.473877 run osmo-hlr_10.42.42.2(pid=23513): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23513)] 12:44:44.523318 run osmo-hlr_10.42.42.2(pid=23513): stdout: | (launched: 2022-12-14_12:44:41.565192) 12:44:44.574298 run osmo-hlr_10.42.42.2(pid=23513): stderr: | [0;m[1;31m20221214124441764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124441764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124441764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124441764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124441764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124441764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124441776 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124441784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124441784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124441785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:44.645374 run osmo-msc_10.42.42.6(pid=23519): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23519)] 12:44:44.694512 run osmo-msc_10.42.42.6(pid=23519): stdout: | (launched: 2022-12-14_12:44:43.518986) 12:44:44.745751 run osmo-msc_10.42.42.6(pid=23519): stderr: | [0;m[38;5;43m20221214124443841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124443841 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd3acea7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124443841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124443841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124443841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124443841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124443843 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124443843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124443844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124443844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:44:44.797253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23512): Terminating (SIGTERM) 12:44:44.838531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23515): Terminating (SIGTERM) 12:44:44.879686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23518): Terminating (SIGTERM) 12:44:44.921118 --- ParallelTerminationStrategy: PID 23512 died... 12:44:44.940715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23512): Terminated: ok {rc=0} 12:44:44.985963 --- ParallelTerminationStrategy: PID 23515 died... 12:44:45.005044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23515): Terminated: ok {rc=0} 12:44:45.050194 --- ParallelTerminationStrategy: PID 23518 died... 12:44:45.069407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23518): Terminated: ok {rc=0} 12:44:45.156097 bus /sierra_3: Setting Powered False 12:44:46.259666 bus /sierra_3: Setting Powered False 12:44:47.382733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 12:44:48.641242 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:44:48.647359 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:44:48.701379 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:44:48.728587 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:44:48.779689 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:44:48.832145 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:44:48.858309 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:44:49.408911 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 12:44:49.414278 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:44:49.425149 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:44:49.461650 tst handover.py: using LAC 40982 12:44:49.579670 tst handover.py: using RAC 182 12:44:49.694619 tst handover.py: using CellId 40982 12:44:49.810432 tst handover.py: using BVCI 40983 12:44:49.920286 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:44:49.965750 tst handover.py: using LAC 40983 12:44:50.082941 tst handover.py: using RAC 183 12:44:50.198122 tst handover.py: using CellId 40983 12:44:50.314886 tst handover.py: using BVCI 40984 12:44:50.434024 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:44:50.445334 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:44:50.456300 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:44:50.467312 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:44:50.478981 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:44:50.490649 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:44:50.607111 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:44:50.725623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:44:51.193130 run create_hlr_db(pid=23524): Launched 12:44:51.322959 bus /sierra_2: Setting Powered False 12:44:52.386025 run create_hlr_db(pid=23524): Terminated: ok {rc=0} 12:44:52.788893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23526): Launched 12:44:53.087100 run osmo-hlr_10.42.42.2(pid=23527): Launched 12:44:53.201949 run osmo-stp_10.42.42.5: Starting osmo-stp 12:44:53.685846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23529): Launched 12:44:53.990709 run osmo-stp_10.42.42.5(pid=23530): Launched 12:44:54.112754 run osmo-msc_10.42.42.6: Starting osmo-msc 12:44:54.663969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23532): Launched 12:44:54.984443 run osmo-msc_10.42.42.6(pid=23533): Launched 12:44:55.162321 run osmo-stp_10.42.42.5(pid=23530): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23530)] 12:44:55.296397 run osmo-stp_10.42.42.5(pid=23530): stdout: | (launched: 2022-12-14_12:44:53.932237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:55.432059 run osmo-stp_10.42.42.5(pid=23530): stderr: | [0;m[38;5;43m20221214124454123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124454123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124454124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124454124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124454125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124454125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124454125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:55.566127 run osmo-stp_10.42.42.5(pid=23530): stdout: | (launched: 2022-12-14_12:44:53.932237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:44:55.693085 run osmo-stp_10.42.42.5(pid=23530): stderr: | [0;m[38;5;43m20221214124454123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124454123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124454124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124454124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124454125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124454125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124454125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:44:55.845890 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23530): Process ended prematurely: osmo-stp_10.42.42.5(pid=23530) [trial-2404↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23530)] [trial-2404↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 12:44:55.854714 tst handover.py:18: Test FAILED (6.4 sec) 12:44:55.881588 run osmo-hlr_10.42.42.2(pid=23527): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23527)] 12:44:55.931350 run osmo-hlr_10.42.42.2(pid=23527): stdout: | (launched: 2022-12-14_12:44:53.032352) 12:44:55.983127 run osmo-hlr_10.42.42.2(pid=23527): stderr: | [0;m[1;31m20221214124453206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124453206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124453206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124453206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124453206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124453206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124453219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124453228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124453229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124453229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:44:56.054575 run osmo-msc_10.42.42.6(pid=23533): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23533)] 12:44:56.104080 run osmo-msc_10.42.42.6(pid=23533): stdout: | (launched: 2022-12-14_12:44:54.926242) 12:44:56.155084 run osmo-msc_10.42.42.6(pid=23533): stderr: | [0;m[38;5;43m20221214124455248 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124455248 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90aa5f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124455249 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124455249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124455249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124455249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124455251 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124455251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124455251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124455251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:44:56.206361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23526): Terminating (SIGTERM) 12:44:56.247621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23529): Terminating (SIGTERM) 12:44:56.288711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23532): Terminating (SIGTERM) 12:44:56.330254 --- ParallelTerminationStrategy: PID 23526 died... 12:44:56.350090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23526): Terminated: ok {rc=0} 12:44:56.395613 --- ParallelTerminationStrategy: PID 23529 died... 12:44:56.414793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23529): Terminated: ok {rc=0} 12:44:56.460405 --- ParallelTerminationStrategy: PID 23532 died... 12:44:56.479726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23532): Terminated: ok {rc=0} 12:44:56.566429 bus /sierra_3: Setting Powered False 12:44:57.664343 bus /sierra_3: Setting Powered False 12:44:58.780212 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 12:45:00.036077 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:00.041224 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 12:45:00.077797 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 12:45:00.103967 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 12:45:00.154173 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 12:45:00.190261 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 12:45:00.217071 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 12:45:00.766331 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 12:45:00.771715 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:45:00.782586 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 12:45:00.815995 tst handover.py: using LAC 40984 12:45:00.971220 tst handover.py: using RAC 184 12:45:01.090108 tst handover.py: using CellId 40984 12:45:01.219689 tst handover.py: using BVCI 40985 12:45:01.332061 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 12:45:01.379440 tst handover.py: using LAC 40985 12:45:01.501673 tst handover.py: using RAC 185 12:45:01.641626 tst handover.py: using CellId 40985 12:45:01.769494 tst handover.py: using BVCI 40986 12:45:01.920577 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:45:01.935599 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:45:01.949941 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:45:01.965700 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:45:01.981459 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:45:01.996941 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 12:45:02.130107 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 12:45:02.262273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:02.703105 run create_hlr_db(pid=23541): Launched 12:45:02.816559 bus /sierra_2: Setting Powered False 12:45:03.876143 run create_hlr_db(pid=23541): Terminated: ok {rc=0} 12:45:04.287713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23543): Launched 12:45:04.607603 run osmo-hlr_10.42.42.2(pid=23544): Launched 12:45:04.729298 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:05.251135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23546): Launched 12:45:05.569987 run osmo-stp_10.42.42.5(pid=23547): Launched 12:45:05.691183 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:06.242829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23549): Launched 12:45:06.562204 run osmo-msc_10.42.42.6(pid=23550): Launched 12:45:06.739677 run osmo-stp_10.42.42.5(pid=23547): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23547)] 12:45:06.874643 run osmo-stp_10.42.42.5(pid=23547): stdout: | (launched: 2022-12-14_12:45:05.511492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:07.009309 run osmo-stp_10.42.42.5(pid=23547): stderr: | [0;m[38;5;43m20221214124505705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124505705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124505705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124505706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124505706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124505706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124505706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:07.143377 run osmo-stp_10.42.42.5(pid=23547): stdout: | (launched: 2022-12-14_12:45:05.511492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:07.269749 run osmo-stp_10.42.42.5(pid=23547): stderr: | [0;m[38;5;43m20221214124505705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124505705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124505705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124505706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124505706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124505706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124505706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:07.421682 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23547): Process ended prematurely: osmo-stp_10.42.42.5(pid=23547) [trial-2404↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23547)] [trial-2404↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 12:45:07.430578 tst handover.py:18: Test FAILED (6.7 sec) 12:45:07.457529 run osmo-hlr_10.42.42.2(pid=23544): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23544)] 12:45:07.507068 run osmo-hlr_10.42.42.2(pid=23544): stdout: | (launched: 2022-12-14_12:45:04.549156) 12:45:07.558397 run osmo-hlr_10.42.42.2(pid=23544): stderr: | [0;m[1;31m20221214124504746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124504746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124504746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124504746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124504746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124504746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124504759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124504767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124504767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124504767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:07.629874 run osmo-msc_10.42.42.6(pid=23550): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23550)] 12:45:07.679324 run osmo-msc_10.42.42.6(pid=23550): stdout: | (launched: 2022-12-14_12:45:06.503556) 12:45:07.730498 run osmo-msc_10.42.42.6(pid=23550): stderr: | [0;m[38;5;43m20221214124506825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124506825 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5c27e6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124506825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124506825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124506826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124506826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124506827 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124506828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124506828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124506828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:07.782458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23543): Terminating (SIGTERM) 12:45:07.823625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23546): Terminating (SIGTERM) 12:45:07.864833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23549): Terminating (SIGTERM) 12:45:07.906317 --- ParallelTerminationStrategy: PID 23543 died... 12:45:07.925972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23543): Terminated: ok {rc=0} 12:45:07.971335 --- ParallelTerminationStrategy: PID 23546 died... 12:45:07.990664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23546): Terminated: ok {rc=0} 12:45:08.036267 --- ParallelTerminationStrategy: PID 23549 died... 12:45:08.055574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23549): Terminated: ok {rc=0} 12:45:08.141920 bus /sierra_3: Setting Powered False 12:45:09.239938 bus /sierra_3: Setting Powered False 12:45:10.354262 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 12:45:11.592704 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:11.598292 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:45:11.648886 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:45:11.675815 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:45:11.727538 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:45:11.778680 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:45:11.805600 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:45:12.357882 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 12:45:12.363537 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:45:12.374916 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:45:12.409360 tst handover.py: using LAC 40986 12:45:12.534693 tst handover.py: using RAC 186 12:45:12.659699 tst handover.py: using CellId 40986 12:45:12.788786 tst handover.py: using BVCI 40987 12:45:12.906596 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:45:12.954840 tst handover.py: using LAC 40987 12:45:13.079766 tst handover.py: using RAC 187 12:45:13.196811 tst handover.py: using CellId 40987 12:45:13.311964 tst handover.py: using BVCI 40988 12:45:13.420066 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:45:13.430921 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:45:13.441540 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:45:13.452090 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:45:13.462824 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:45:13.474136 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:45:13.593800 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:45:13.711600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:14.148445 run create_hlr_db(pid=23555): Launched 12:45:14.262404 bus /sierra_2: Setting Powered False 12:45:15.322774 run create_hlr_db(pid=23555): Terminated: ok {rc=0} 12:45:15.732778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23557): Launched 12:45:16.070799 run osmo-hlr_10.42.42.2(pid=23558): Launched 12:45:16.185958 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:16.933693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23560): Launched 12:45:17.293522 run osmo-stp_10.42.42.5(pid=23561): Launched 12:45:17.440588 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:17.996025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23563): Launched 12:45:18.316248 run osmo-msc_10.42.42.6(pid=23564): Launched 12:45:18.494841 run osmo-stp_10.42.42.5(pid=23561): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23561)] 12:45:18.629709 run osmo-stp_10.42.42.5(pid=23561): stdout: | (launched: 2022-12-14_12:45:17.233332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:18.768754 run osmo-stp_10.42.42.5(pid=23561): stderr: | [0;m[38;5;43m20221214124517479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124517479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124517480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124517480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124517481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124517482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124517482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:18.901461 run osmo-stp_10.42.42.5(pid=23561): stdout: | (launched: 2022-12-14_12:45:17.233332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:19.028137 run osmo-stp_10.42.42.5(pid=23561): stderr: | [0;m[38;5;43m20221214124517479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124517479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124517480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124517480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124517481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124517482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124517482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:19.179767 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23561): Process ended prematurely: osmo-stp_10.42.42.5(pid=23561) [trial-2404↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23561)] [trial-2404↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 12:45:19.188901 tst handover.py:18: Test FAILED (6.8 sec) 12:45:19.215863 run osmo-hlr_10.42.42.2(pid=23558): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23558)] 12:45:19.265570 run osmo-hlr_10.42.42.2(pid=23558): stdout: | (launched: 2022-12-14_12:45:16.011468) 12:45:19.316908 run osmo-hlr_10.42.42.2(pid=23558): stderr: | [0;m[1;31m20221214124516442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124516442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124516442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124516442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124516442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124516442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124516462 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124516482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124516483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124516483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:19.388551 run osmo-msc_10.42.42.6(pid=23564): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23564)] 12:45:19.437737 run osmo-msc_10.42.42.6(pid=23564): stdout: | (launched: 2022-12-14_12:45:18.257913) 12:45:19.488839 run osmo-msc_10.42.42.6(pid=23564): stderr: | [0;m[38;5;43m20221214124518602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124518602 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f161c35cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124518603 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124518603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124518603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124518603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124518605 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124518605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124518605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124518605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:19.540157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23557): Terminating (SIGTERM) 12:45:19.581217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23560): Terminating (SIGTERM) 12:45:19.622717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23563): Terminating (SIGTERM) 12:45:19.664117 --- ParallelTerminationStrategy: PID 23557 died... 12:45:19.683851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23557): Terminated: ok {rc=0} 12:45:19.729320 --- ParallelTerminationStrategy: PID 23560 died... 12:45:19.748734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23560): Terminated: ok {rc=0} 12:45:19.794050 --- ParallelTerminationStrategy: PID 23563 died... 12:45:19.813233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23563): Terminated: ok {rc=0} 12:45:19.899299 bus /sierra_3: Setting Powered False 12:45:20.997091 bus /sierra_3: Setting Powered False 12:45:22.110599 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:45:23.364292 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:23.370803 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:45:23.418445 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:45:23.445490 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:45:23.496325 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:45:23.543881 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:45:23.570981 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:45:24.121915 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:45:24.127222 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:45:24.138475 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:45:24.172475 tst handover.py: using LAC 40988 12:45:24.289398 tst handover.py: using RAC 188 12:45:24.404718 tst handover.py: using CellId 40988 12:45:24.519962 tst handover.py: using BVCI 40989 12:45:24.628358 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:45:24.673756 tst handover.py: using LAC 40989 12:45:24.799497 tst handover.py: using RAC 189 12:45:24.923824 tst handover.py: using CellId 40989 12:45:25.047597 tst handover.py: using BVCI 40990 12:45:25.165148 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:45:25.176565 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:45:25.187765 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:45:25.199065 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:45:25.210623 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:45:25.221850 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:45:25.337765 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:45:25.457346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:25.925920 run create_hlr_db(pid=23569): Launched 12:45:26.055103 bus /sierra_2: Setting Powered False 12:45:27.118207 run create_hlr_db(pid=23569): Terminated: ok {rc=0} 12:45:27.521258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23571): Launched 12:45:27.820097 run osmo-hlr_10.42.42.2(pid=23572): Launched 12:45:27.934279 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:28.426809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23574): Launched 12:45:28.724796 run osmo-stp_10.42.42.5(pid=23575): Launched 12:45:28.839003 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:29.354143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23577): Launched 12:45:29.652853 run osmo-msc_10.42.42.6(pid=23578): Launched 12:45:29.819745 run osmo-stp_10.42.42.5(pid=23575): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23575)] 12:45:29.947108 run osmo-stp_10.42.42.5(pid=23575): stdout: | (launched: 2022-12-14_12:45:28.669840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:30.073822 run osmo-stp_10.42.42.5(pid=23575): stderr: | [0;m[38;5;43m20221214124528842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124528842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124528842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124528843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124528843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124528843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124528843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:30.198527 run osmo-stp_10.42.42.5(pid=23575): stdout: | (launched: 2022-12-14_12:45:28.669840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:30.317876 run osmo-stp_10.42.42.5(pid=23575): stderr: | [0;m[38;5;43m20221214124528842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124528842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124528842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124528843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124528843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124528843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124528843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:30.460125 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23575): Process ended prematurely: osmo-stp_10.42.42.5(pid=23575) [trial-2404↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23575)] [trial-2404↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 12:45:30.468284 tst handover.py:18: Test FAILED (6.3 sec) 12:45:30.494217 run osmo-hlr_10.42.42.2(pid=23572): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23572)] 12:45:30.542396 run osmo-hlr_10.42.42.2(pid=23572): stdout: | (launched: 2022-12-14_12:45:27.765210) 12:45:30.591374 run osmo-hlr_10.42.42.2(pid=23572): stderr: | [0;m[1;31m20221214124527940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124527940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124527940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124527940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124527940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124527940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124527952 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124527962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124527962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124527962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:30.660073 run osmo-msc_10.42.42.6(pid=23578): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23578)] 12:45:30.706840 run osmo-msc_10.42.42.6(pid=23578): stdout: | (launched: 2022-12-14_12:45:29.597719) 12:45:30.755591 run osmo-msc_10.42.42.6(pid=23578): stderr: | [0;m[38;5;43m20221214124529869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124529869 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f89124f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124529870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124529870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124529870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124529870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124529872 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124529872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124529872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124529872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:30.804889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23571): Terminating (SIGTERM) 12:45:30.848680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23574): Terminating (SIGTERM) 12:45:30.900167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23577): Terminating (SIGTERM) 12:45:30.953876 --- ParallelTerminationStrategy: PID 23571 died... 12:45:30.974050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23571): Terminated: ok {rc=0} 12:45:31.020083 --- ParallelTerminationStrategy: PID 23574 died... 12:45:31.040374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23574): Terminated: ok {rc=0} 12:45:31.086362 --- ParallelTerminationStrategy: PID 23577 died... 12:45:31.106540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23577): Terminated: ok {rc=0} 12:45:31.192303 bus /sierra_3: Setting Powered False 12:45:32.287671 bus /sierra_3: Setting Powered False 12:45:33.400634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:45:34.658159 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:34.663281 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:45:34.713538 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:45:34.739528 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:45:34.790330 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:45:34.842508 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:45:34.869514 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:45:35.422243 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:45:35.427874 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:45:35.439409 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:45:35.476888 tst handover.py: using LAC 40990 12:45:35.602339 tst handover.py: using RAC 190 12:45:35.726990 tst handover.py: using CellId 40990 12:45:35.851769 tst handover.py: using BVCI 40991 12:45:35.967898 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:45:36.017171 tst handover.py: using LAC 40991 12:45:36.141954 tst handover.py: using RAC 191 12:45:36.267035 tst handover.py: using CellId 40991 12:45:36.392898 tst handover.py: using BVCI 40992 12:45:36.509072 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:45:36.520303 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:45:36.531461 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:45:36.542589 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:45:36.554029 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:45:36.565375 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:45:36.686277 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:45:36.803073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:37.238451 run create_hlr_db(pid=23583): Launched 12:45:37.352791 bus /sierra_2: Setting Powered False 12:45:38.412197 run create_hlr_db(pid=23583): Terminated: ok {rc=0} 12:45:38.804830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23585): Launched 12:45:39.102783 run osmo-hlr_10.42.42.2(pid=23586): Launched 12:45:39.216729 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:39.718712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23588): Launched 12:45:40.016140 run osmo-stp_10.42.42.5(pid=23589): Launched 12:45:40.130202 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:40.645006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23591): Launched 12:45:40.944043 run osmo-msc_10.42.42.6(pid=23592): Launched 12:45:41.111094 run osmo-stp_10.42.42.5(pid=23589): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23589)] 12:45:41.238120 run osmo-stp_10.42.42.5(pid=23589): stdout: | (launched: 2022-12-14_12:45:39.961256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:41.364251 run osmo-stp_10.42.42.5(pid=23589): stderr: | [0;m[38;5;43m20221214124540131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124540131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124540131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124540131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124540134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124540134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124540134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:41.488165 run osmo-stp_10.42.42.5(pid=23589): stdout: | (launched: 2022-12-14_12:45:39.961256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:41.606753 run osmo-stp_10.42.42.5(pid=23589): stderr: | [0;m[38;5;43m20221214124540131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124540131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124540131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124540131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124540134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124540134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124540134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:41.748657 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23589): Process ended prematurely: osmo-stp_10.42.42.5(pid=23589) [trial-2404↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23589)] [trial-2404↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 12:45:41.756808 tst handover.py:18: Test FAILED (6.3 sec) 12:45:41.782381 run osmo-hlr_10.42.42.2(pid=23586): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23586)] 12:45:41.829675 run osmo-hlr_10.42.42.2(pid=23586): stdout: | (launched: 2022-12-14_12:45:39.047999) 12:45:41.878504 run osmo-hlr_10.42.42.2(pid=23586): stderr: | [0;m[1;31m20221214124539224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124539224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124539224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124539224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124539225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124539225 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124539237 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124539247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124539247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124539247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:41.948404 run osmo-msc_10.42.42.6(pid=23592): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23592)] 12:45:41.995514 run osmo-msc_10.42.42.6(pid=23592): stdout: | (launched: 2022-12-14_12:45:40.889081) 12:45:42.044045 run osmo-msc_10.42.42.6(pid=23592): stderr: | [0;m[38;5;43m20221214124541162 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124541162 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe785410c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124541162 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124541162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124541162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124541162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124541164 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124541164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124541165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124541165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:42.093510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23585): Terminating (SIGTERM) 12:45:42.132768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23588): Terminating (SIGTERM) 12:45:42.171927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23591): Terminating (SIGTERM) 12:45:42.211511 --- ParallelTerminationStrategy: PID 23585 died... 12:45:42.230669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23585): Terminated: ok {rc=0} 12:45:42.274273 --- ParallelTerminationStrategy: PID 23588 died... 12:45:42.293229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23588): Terminated: ok {rc=0} 12:45:42.337043 --- ParallelTerminationStrategy: PID 23591 died... 12:45:42.355727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23591): Terminated: ok {rc=0} 12:45:42.440728 bus /sierra_3: Setting Powered False 12:45:43.536635 bus /sierra_3: Setting Powered False 12:45:44.650593 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 12:45:45.935567 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:45.940742 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:45:45.981126 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:45:46.009164 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:45:46.062879 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:45:46.112446 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:45:46.140212 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:45:46.678784 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 12:45:46.686340 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:45:46.698152 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 12:45:46.732396 tst handover.py: using LAC 40992 12:45:46.888828 tst handover.py: using RAC 192 12:45:47.051289 tst handover.py: using CellId 40992 12:45:47.179014 tst handover.py: using BVCI 40993 12:45:47.298449 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 12:45:47.332722 tst handover.py: using LAC 40993 12:45:47.456535 tst handover.py: using RAC 193 12:45:47.580692 tst handover.py: using CellId 40993 12:45:47.704100 tst handover.py: using BVCI 40994 12:45:47.820603 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:45:47.831937 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:45:47.842828 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:45:47.853848 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:45:47.864714 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:45:47.875729 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 12:45:47.992309 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 12:45:48.112186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:48.580677 run create_hlr_db(pid=23597): Launched 12:45:48.709864 bus /sierra_2: Setting Powered False 12:45:49.773513 run create_hlr_db(pid=23597): Terminated: ok {rc=0} 12:45:50.175833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23599): Launched 12:45:50.474347 run osmo-hlr_10.42.42.2(pid=23600): Launched 12:45:50.588182 run osmo-stp_10.42.42.5: Starting osmo-stp 12:45:51.093201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23602): Launched 12:45:51.392777 run osmo-stp_10.42.42.5(pid=23603): Launched 12:45:51.508248 run osmo-msc_10.42.42.6: Starting osmo-msc 12:45:52.029053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23606): Launched 12:45:52.334735 run osmo-msc_10.42.42.6(pid=23607): Launched 12:45:52.501761 run osmo-stp_10.42.42.5(pid=23603): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23603)] 12:45:52.629231 run osmo-stp_10.42.42.5(pid=23603): stdout: | (launched: 2022-12-14_12:45:51.337420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:52.756605 run osmo-stp_10.42.42.5(pid=23603): stderr: | [0;m[38;5;43m20221214124551507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124551507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124551507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124551508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124551508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124551508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124551509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:52.881477 run osmo-stp_10.42.42.5(pid=23603): stdout: | (launched: 2022-12-14_12:45:51.337420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:45:53.000146 run osmo-stp_10.42.42.5(pid=23603): stderr: | [0;m[38;5;43m20221214124551507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124551507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124551507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124551508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124551508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124551508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124551509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:45:53.142220 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23603): Process ended prematurely: osmo-stp_10.42.42.5(pid=23603) [trial-2404↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23603)] [trial-2404↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 12:45:53.150635 tst handover.py:18: Test FAILED (6.5 sec) 12:45:53.176557 run osmo-hlr_10.42.42.2(pid=23600): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23600)] 12:45:53.224661 run osmo-hlr_10.42.42.2(pid=23600): stdout: | (launched: 2022-12-14_12:45:50.419253) 12:45:53.273881 run osmo-hlr_10.42.42.2(pid=23600): stderr: | [0;m[1;31m20221214124550595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124550595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124550595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124550595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124550595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124550595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124550607 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124550616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124550616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124550616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:45:53.343092 run osmo-msc_10.42.42.6(pid=23607): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23607)] 12:45:53.390298 run osmo-msc_10.42.42.6(pid=23607): stdout: | (launched: 2022-12-14_12:45:52.279725) 12:45:53.439478 run osmo-msc_10.42.42.6(pid=23607): stderr: | [0;m[38;5;43m20221214124552551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124552551 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faaf8041c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124552551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124552551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124552551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124552552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124552553 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124552554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124552554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124552554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:45:53.489074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23599): Terminating (SIGTERM) 12:45:53.529138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23602): Terminating (SIGTERM) 12:45:53.569363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23606): Terminating (SIGTERM) 12:45:53.609697 --- ParallelTerminationStrategy: PID 23599 died... 12:45:53.629206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23599): Terminated: ok {rc=0} 12:45:53.673270 --- ParallelTerminationStrategy: PID 23602 died... 12:45:53.692258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23602): Terminated: ok {rc=0} 12:45:53.736249 --- ParallelTerminationStrategy: PID 23606 died... 12:45:53.755404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23606): Terminated: ok {rc=0} 12:45:53.839358 bus /sierra_3: Setting Powered False 12:45:54.937842 bus /sierra_3: Setting Powered False 12:45:56.057402 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 12:45:57.294322 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:45:57.300216 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:45:57.351425 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:45:57.378448 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:45:57.430048 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:45:57.481451 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:45:57.508551 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:45:58.063098 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 12:45:58.068606 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:45:58.079767 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:45:58.114373 tst handover.py: using LAC 40994 12:45:58.232630 tst handover.py: using RAC 194 12:45:58.349737 tst handover.py: using CellId 40994 12:45:58.477063 tst handover.py: using BVCI 40995 12:45:58.593081 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:45:58.642313 tst handover.py: using LAC 40995 12:45:58.768070 tst handover.py: using RAC 195 12:45:58.895316 tst handover.py: using CellId 40995 12:45:59.020776 tst handover.py: using BVCI 40996 12:45:59.137925 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:45:59.148896 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:45:59.159925 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:45:59.171000 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:45:59.182047 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:45:59.193002 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:45:59.310815 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:45:59.426947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:45:59.863599 run create_hlr_db(pid=23612): Launched 12:45:59.978463 bus /sierra_2: Setting Powered False 12:46:01.036329 run create_hlr_db(pid=23612): Terminated: ok {rc=0} 12:46:01.438421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23614): Launched 12:46:01.757324 run osmo-hlr_10.42.42.2(pid=23615): Launched 12:46:01.996618 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:02.610960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23617): Launched 12:46:02.931318 run osmo-stp_10.42.42.5(pid=23618): Launched 12:46:03.052089 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:03.603775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23620): Launched 12:46:03.924670 run osmo-msc_10.42.42.6(pid=23621): Launched 12:46:04.103133 run osmo-stp_10.42.42.5(pid=23618): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23618)] 12:46:04.238096 run osmo-stp_10.42.42.5(pid=23618): stdout: | (launched: 2022-12-14_12:46:02.872807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:04.373505 run osmo-stp_10.42.42.5(pid=23618): stderr: | [0;m[38;5;43m20221214124603067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124603067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124603068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124603068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124603069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124603069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124603069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:04.509072 run osmo-stp_10.42.42.5(pid=23618): stdout: | (launched: 2022-12-14_12:46:02.872807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:04.636517 run osmo-stp_10.42.42.5(pid=23618): stderr: | [0;m[38;5;43m20221214124603067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124603067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124603068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124603068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124603069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124603069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124603069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:04.789503 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23618): Process ended prematurely: osmo-stp_10.42.42.5(pid=23618) [trial-2404↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23618)] [trial-2404↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 12:46:04.798590 tst handover.py:18: Test FAILED (6.7 sec) 12:46:04.826100 run osmo-hlr_10.42.42.2(pid=23615): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23615)] 12:46:04.876543 run osmo-hlr_10.42.42.2(pid=23615): stdout: | (launched: 2022-12-14_12:46:01.698492) 12:46:04.928270 run osmo-hlr_10.42.42.2(pid=23615): stderr: | [0;m[1;31m20221214124602039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124602039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124602039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124602039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124602039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124602039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124602059 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124602075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124602075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124602076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:04.999952 run osmo-msc_10.42.42.6(pid=23621): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23621)] 12:46:05.049739 run osmo-msc_10.42.42.6(pid=23621): stdout: | (launched: 2022-12-14_12:46:03.866057) 12:46:05.101257 run osmo-msc_10.42.42.6(pid=23621): stderr: | [0;m[38;5;43m20221214124604188 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124604188 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f78cc054c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124604188 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124604188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124604189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124604189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124604190 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124604191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124604191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124604191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:05.152705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23614): Terminating (SIGTERM) 12:46:05.194066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23617): Terminating (SIGTERM) 12:46:05.235506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23620): Terminating (SIGTERM) 12:46:05.277281 --- ParallelTerminationStrategy: PID 23614 died... 12:46:05.297388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23614): Terminated: ok {rc=0} 12:46:05.343593 --- ParallelTerminationStrategy: PID 23617 died... 12:46:05.363219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23617): Terminated: ok {rc=0} 12:46:05.409087 --- ParallelTerminationStrategy: PID 23620 died... 12:46:05.428516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23620): Terminated: ok {rc=0} 12:46:05.515504 bus /sierra_3: Setting Powered False 12:46:06.614497 bus /sierra_3: Setting Powered False 12:46:07.732189 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 12:46:08.983420 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:46:08.988705 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:46:09.037871 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:46:09.063842 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:46:09.114220 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:46:09.163058 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:46:09.188854 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:46:09.738674 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 12:46:09.743777 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:46:09.754478 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:46:09.787285 tst handover.py: using LAC 40996 12:46:09.907351 tst handover.py: using RAC 196 12:46:10.023148 tst handover.py: using CellId 40996 12:46:10.138061 tst handover.py: using BVCI 40997 12:46:10.247487 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:46:10.292856 tst handover.py: using LAC 40997 12:46:10.409617 tst handover.py: using RAC 197 12:46:10.534160 tst handover.py: using CellId 40997 12:46:10.658274 tst handover.py: using BVCI 40998 12:46:10.774496 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:46:10.785936 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:46:10.797124 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:46:10.808169 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:46:10.819429 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:46:10.830580 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:46:10.948227 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:46:11.067756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:11.536420 run create_hlr_db(pid=23626): Launched 12:46:11.666342 bus /sierra_2: Setting Powered False 12:46:12.728694 run create_hlr_db(pid=23626): Terminated: ok {rc=0} 12:46:13.132689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23628): Launched 12:46:13.432423 run osmo-hlr_10.42.42.2(pid=23629): Launched 12:46:13.546884 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:14.051330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23631): Launched 12:46:14.349244 run osmo-stp_10.42.42.5(pid=23632): Launched 12:46:14.462248 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:14.978141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23634): Launched 12:46:15.276875 run osmo-msc_10.42.42.6(pid=23635): Launched 12:46:15.443919 run osmo-stp_10.42.42.5(pid=23632): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23632)] 12:46:15.571466 run osmo-stp_10.42.42.5(pid=23632): stdout: | (launched: 2022-12-14_12:46:14.294015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:15.698264 run osmo-stp_10.42.42.5(pid=23632): stderr: | [0;m[38;5;43m20221214124614466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124614466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124614467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124614467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124614467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124614467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124614468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:15.822702 run osmo-stp_10.42.42.5(pid=23632): stdout: | (launched: 2022-12-14_12:46:14.294015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:15.954837 run osmo-stp_10.42.42.5(pid=23632): stderr: | [0;m[38;5;43m20221214124614466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124614466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124614467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124614467 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124614467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124614467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124614468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:16.101762 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23632): Process ended prematurely: osmo-stp_10.42.42.5(pid=23632) [trial-2404↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23632)] [trial-2404↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 12:46:16.110964 tst handover.py:18: Test FAILED (6.4 sec) 12:46:16.138067 run osmo-hlr_10.42.42.2(pid=23629): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23629)] 12:46:16.189108 run osmo-hlr_10.42.42.2(pid=23629): stdout: | (launched: 2022-12-14_12:46:13.377378) 12:46:16.239910 run osmo-hlr_10.42.42.2(pid=23629): stderr: | [0;m[1;31m20221214124613554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124613555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124613555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124613555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124613555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124613555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124613567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124613577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124613578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124613578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:16.311972 run osmo-msc_10.42.42.6(pid=23635): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23635)] 12:46:16.360003 run osmo-msc_10.42.42.6(pid=23635): stdout: | (launched: 2022-12-14_12:46:15.221801) 12:46:16.410973 run osmo-msc_10.42.42.6(pid=23635): stderr: | [0;m[38;5;43m20221214124615493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124615493 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5127231c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124615493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124615494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124615494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124615494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124615496 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124615496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124615496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124615496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:16.462244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23628): Terminating (SIGTERM) 12:46:16.503684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23631): Terminating (SIGTERM) 12:46:16.545719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23634): Terminating (SIGTERM) 12:46:16.587498 --- ParallelTerminationStrategy: PID 23628 died... 12:46:16.608262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23628): Terminated: ok {rc=0} 12:46:16.654202 --- ParallelTerminationStrategy: PID 23631 died... 12:46:16.674846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23631): Terminated: ok {rc=0} 12:46:16.720656 --- ParallelTerminationStrategy: PID 23634 died... 12:46:16.741313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23634): Terminated: ok {rc=0} 12:46:16.830118 bus /sierra_3: Setting Powered False 12:46:17.926293 bus /sierra_3: Setting Powered False 12:46:19.037337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 12:46:20.290872 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:46:20.296285 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:46:20.345822 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:46:20.372824 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:46:20.425027 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:46:20.474506 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:46:20.501523 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:46:21.052774 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 12:46:21.058097 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:46:21.069188 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:46:21.102398 tst handover.py: using LAC 40998 12:46:21.231319 tst handover.py: using RAC 198 12:46:21.349478 tst handover.py: using CellId 40998 12:46:21.465962 tst handover.py: using BVCI 40999 12:46:21.574818 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:46:21.621300 tst handover.py: using LAC 40999 12:46:21.746286 tst handover.py: using RAC 199 12:46:21.871071 tst handover.py: using CellId 40999 12:46:21.994210 tst handover.py: using BVCI 41000 12:46:22.110510 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:46:22.121741 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:46:22.132773 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:46:22.143790 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:46:22.155441 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:46:22.167059 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:46:22.283638 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:46:22.403187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:22.872008 run create_hlr_db(pid=23640): Launched 12:46:23.001646 bus /sierra_2: Setting Powered False 12:46:24.065264 run create_hlr_db(pid=23640): Terminated: ok {rc=0} 12:46:24.467264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23642): Launched 12:46:24.765607 run osmo-hlr_10.42.42.2(pid=23643): Launched 12:46:24.879471 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:25.386382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23645): Launched 12:46:25.683441 run osmo-stp_10.42.42.5(pid=23646): Launched 12:46:25.797074 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:26.314347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23648): Launched 12:46:26.613487 run osmo-msc_10.42.42.6(pid=23649): Launched 12:46:26.780740 run osmo-stp_10.42.42.5(pid=23646): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23646)] 12:46:26.908600 run osmo-stp_10.42.42.5(pid=23646): stdout: | (launched: 2022-12-14_12:46:25.628619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:27.035720 run osmo-stp_10.42.42.5(pid=23646): stderr: | [0;m[38;5;43m20221214124625800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124625801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124625801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124625801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124625802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124625802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124625802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:27.160641 run osmo-stp_10.42.42.5(pid=23646): stdout: | (launched: 2022-12-14_12:46:25.628619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:27.279211 run osmo-stp_10.42.42.5(pid=23646): stderr: | [0;m[38;5;43m20221214124625800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124625801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124625801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124625801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124625802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124625802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124625802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:27.421336 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23646): Process ended prematurely: osmo-stp_10.42.42.5(pid=23646) [trial-2404↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23646)] [trial-2404↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 12:46:27.429713 tst handover.py:18: Test FAILED (6.4 sec) 12:46:27.455506 run osmo-hlr_10.42.42.2(pid=23643): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23643)] 12:46:27.503533 run osmo-hlr_10.42.42.2(pid=23643): stdout: | (launched: 2022-12-14_12:46:24.710573) 12:46:27.552251 run osmo-hlr_10.42.42.2(pid=23643): stderr: | [0;m[1;31m20221214124624886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124624886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124624886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124624886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124624886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124624886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124624897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124624906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124624906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124624906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:27.620474 run osmo-msc_10.42.42.6(pid=23649): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23649)] 12:46:27.666942 run osmo-msc_10.42.42.6(pid=23649): stdout: | (launched: 2022-12-14_12:46:26.558356) 12:46:27.715234 run osmo-msc_10.42.42.6(pid=23649): stderr: | [0;m[38;5;43m20221214124626830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124626830 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5993efdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124626830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124626830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124626830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124626831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124626832 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124626833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124626833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124626833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:27.763888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23642): Terminating (SIGTERM) 12:46:27.803202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23645): Terminating (SIGTERM) 12:46:27.842707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23648): Terminating (SIGTERM) 12:46:27.882484 --- ParallelTerminationStrategy: PID 23642 died... 12:46:27.901756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23642): Terminated: ok {rc=0} 12:46:27.945592 --- ParallelTerminationStrategy: PID 23645 died... 12:46:27.964310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23645): Terminated: ok {rc=0} 12:46:28.007784 --- ParallelTerminationStrategy: PID 23648 died... 12:46:28.026681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23648): Terminated: ok {rc=0} 12:46:28.111822 bus /sierra_3: Setting Powered False 12:46:29.209727 bus /sierra_3: Setting Powered False 12:46:30.320998 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:46:31.601367 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:46:31.611199 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:46:31.670302 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:46:31.702818 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:46:31.768097 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:46:31.832131 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:46:31.859011 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:46:32.384015 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:46:32.390385 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:46:32.401943 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:46:32.436511 tst handover.py: using LAC 41000 12:46:32.563618 tst handover.py: using RAC 200 12:46:32.688886 tst handover.py: using CellId 41000 12:46:32.815462 tst handover.py: using BVCI 41001 12:46:32.931855 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:46:32.981458 tst handover.py: using LAC 41001 12:46:33.106186 tst handover.py: using RAC 201 12:46:33.231936 tst handover.py: using CellId 41001 12:46:33.355796 tst handover.py: using BVCI 41002 12:46:33.472173 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:46:33.483547 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:46:33.494782 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:46:33.506050 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:46:33.517836 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:46:33.529548 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:46:33.647007 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:46:33.762191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:34.199823 run create_hlr_db(pid=23654): Launched 12:46:34.314069 bus /sierra_2: Setting Powered False 12:46:35.373657 run create_hlr_db(pid=23654): Terminated: ok {rc=0} 12:46:35.786157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23656): Launched 12:46:36.107661 run osmo-hlr_10.42.42.2(pid=23657): Launched 12:46:36.230801 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:36.760798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23659): Launched 12:46:37.062260 run osmo-stp_10.42.42.5(pid=23660): Launched 12:46:37.175946 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:37.691284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23662): Launched 12:46:37.990316 run osmo-msc_10.42.42.6(pid=23663): Launched 12:46:38.157092 run osmo-stp_10.42.42.5(pid=23660): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23660)] 12:46:38.284402 run osmo-stp_10.42.42.5(pid=23660): stdout: | (launched: 2022-12-14_12:46:37.007193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:38.411401 run osmo-stp_10.42.42.5(pid=23660): stderr: | [0;m[38;5;43m20221214124637178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124637179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124637179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124637179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124637180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124637180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124637180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:38.536199 run osmo-stp_10.42.42.5(pid=23660): stdout: | (launched: 2022-12-14_12:46:37.007193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:38.655373 run osmo-stp_10.42.42.5(pid=23660): stderr: | [0;m[38;5;43m20221214124637178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124637179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124637179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124637179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124637180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124637180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124637180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:38.798272 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23660): Process ended prematurely: osmo-stp_10.42.42.5(pid=23660) [trial-2404↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23660)] [trial-2404↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 12:46:38.806683 tst handover.py:18: Test FAILED (6.4 sec) 12:46:38.832303 run osmo-hlr_10.42.42.2(pid=23657): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23657)] 12:46:38.879939 run osmo-hlr_10.42.42.2(pid=23657): stdout: | (launched: 2022-12-14_12:46:36.049069) 12:46:38.928767 run osmo-hlr_10.42.42.2(pid=23657): stderr: | [0;m[1;31m20221214124636247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124636247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124636247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124636247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124636248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124636248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124636260 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124636268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124636269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124636269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:38.997426 run osmo-msc_10.42.42.6(pid=23663): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23663)] 12:46:39.044428 run osmo-msc_10.42.42.6(pid=23663): stdout: | (launched: 2022-12-14_12:46:37.935108) 12:46:39.093439 run osmo-msc_10.42.42.6(pid=23663): stderr: | [0;m[38;5;43m20221214124638204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124638204 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f10d03c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124638204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124638204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124638204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124638205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124638206 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124638207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124638207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124638207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:39.142751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23656): Terminating (SIGTERM) 12:46:39.182415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23659): Terminating (SIGTERM) 12:46:39.222063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23662): Terminating (SIGTERM) 12:46:39.261804 --- ParallelTerminationStrategy: PID 23656 died... 12:46:39.281054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23656): Terminated: ok {rc=0} 12:46:39.324772 --- ParallelTerminationStrategy: PID 23659 died... 12:46:39.343678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23659): Terminated: ok {rc=0} 12:46:39.387206 --- ParallelTerminationStrategy: PID 23662 died... 12:46:39.406338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23662): Terminated: ok {rc=0} 12:46:39.490416 bus /sierra_3: Setting Powered False 12:46:40.590190 bus /sierra_3: Setting Powered False 12:46:41.707089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:46:42.965802 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:46:42.971295 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:46:43.022267 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:46:43.049237 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:46:43.100169 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:46:43.151043 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:46:43.177981 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:46:43.732121 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:46:43.737478 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:46:43.748661 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:46:43.782905 tst handover.py: using LAC 41002 12:46:43.907167 tst handover.py: using RAC 202 12:46:44.034098 tst handover.py: using CellId 41002 12:46:44.159548 tst handover.py: using BVCI 41003 12:46:44.275319 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:46:44.324486 tst handover.py: using LAC 41003 12:46:44.448540 tst handover.py: using RAC 203 12:46:44.572638 tst handover.py: using CellId 41003 12:46:44.695833 tst handover.py: using BVCI 41004 12:46:44.813918 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:46:44.825312 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:46:44.836515 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:46:44.847699 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:46:44.858874 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:46:44.870133 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:46:44.988537 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:46:45.106767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:45.543409 run create_hlr_db(pid=23668): Launched 12:46:45.658733 bus /sierra_2: Setting Powered False 12:46:46.717145 run create_hlr_db(pid=23668): Terminated: ok {rc=0} 12:46:47.168139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23670): Launched 12:46:47.479385 run osmo-hlr_10.42.42.2(pid=23671): Launched 12:46:47.594361 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:48.079981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23673): Launched 12:46:48.377543 run osmo-stp_10.42.42.5(pid=23674): Launched 12:46:48.491671 run osmo-msc_10.42.42.6: Starting osmo-msc 12:46:49.008846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23676): Launched 12:46:49.308137 run osmo-msc_10.42.42.6(pid=23677): Launched 12:46:49.475835 run osmo-stp_10.42.42.5(pid=23674): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23674)] 12:46:49.603265 run osmo-stp_10.42.42.5(pid=23674): stdout: | (launched: 2022-12-14_12:46:48.322656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:49.730051 run osmo-stp_10.42.42.5(pid=23674): stderr: | [0;m[38;5;43m20221214124648494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124648494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124648494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124648495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124648495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124648495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124648495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:49.854386 run osmo-stp_10.42.42.5(pid=23674): stdout: | (launched: 2022-12-14_12:46:48.322656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:46:49.973179 run osmo-stp_10.42.42.5(pid=23674): stderr: | [0;m[38;5;43m20221214124648494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124648494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124648494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124648495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124648495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124648495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124648495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:46:50.115296 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23674): Process ended prematurely: osmo-stp_10.42.42.5(pid=23674) [trial-2404↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23674)] [trial-2404↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 12:46:50.123473 tst handover.py:18: Test FAILED (6.4 sec) 12:46:50.148921 run osmo-hlr_10.42.42.2(pid=23671): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23671)] 12:46:50.196458 run osmo-hlr_10.42.42.2(pid=23671): stdout: | (launched: 2022-12-14_12:46:47.423818) 12:46:50.245479 run osmo-hlr_10.42.42.2(pid=23671): stderr: | [0;m[1;31m20221214124647599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124647599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124647599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124647599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124647599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124647599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124647632 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124647641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124647641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124647641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:46:50.313860 run osmo-msc_10.42.42.6(pid=23677): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23677)] 12:46:50.360470 run osmo-msc_10.42.42.6(pid=23677): stdout: | (launched: 2022-12-14_12:46:49.253243) 12:46:50.409189 run osmo-msc_10.42.42.6(pid=23677): stderr: | [0;m[38;5;43m20221214124649522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124649523 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fddc6bedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124649523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124649523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124649523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124649523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124649525 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124649525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124649525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124649525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:46:50.458030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23670): Terminating (SIGTERM) 12:46:50.497357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23673): Terminating (SIGTERM) 12:46:50.536623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23676): Terminating (SIGTERM) 12:46:50.576048 --- ParallelTerminationStrategy: PID 23670 died... 12:46:50.595189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23670): Terminated: ok {rc=0} 12:46:50.638788 --- ParallelTerminationStrategy: PID 23673 died... 12:46:50.657402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23673): Terminated: ok {rc=0} 12:46:50.700750 --- ParallelTerminationStrategy: PID 23676 died... 12:46:50.719453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23676): Terminated: ok {rc=0} 12:46:50.806720 bus /sierra_3: Setting Powered False 12:46:51.906687 bus /sierra_3: Setting Powered False 12:46:53.022680 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 12:46:54.275265 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:46:54.280093 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:46:54.315728 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:46:54.342362 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:46:54.393086 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:46:54.429011 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:46:54.455541 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:46:55.004939 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 12:46:55.010131 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:46:55.020743 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 12:46:55.056802 tst handover.py: using LAC 41004 12:46:55.175870 tst handover.py: using RAC 204 12:46:55.305423 tst handover.py: using CellId 41004 12:46:55.432021 tst handover.py: using BVCI 41005 12:46:55.542231 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 12:46:55.575427 tst handover.py: using LAC 41005 12:46:55.691630 tst handover.py: using RAC 205 12:46:55.806964 tst handover.py: using CellId 41005 12:46:55.923130 tst handover.py: using BVCI 41006 12:46:56.032598 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:46:56.043442 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:46:56.054037 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:46:56.064491 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:46:56.075313 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:46:56.086334 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 12:46:56.205586 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 12:46:56.320384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:46:56.757157 run create_hlr_db(pid=23682): Launched 12:46:56.870491 bus /sierra_2: Setting Powered False 12:46:57.930636 run create_hlr_db(pid=23682): Terminated: ok {rc=0} 12:46:58.322117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23684): Launched 12:46:58.619522 run osmo-hlr_10.42.42.2(pid=23685): Launched 12:46:58.733574 run osmo-stp_10.42.42.5: Starting osmo-stp 12:46:59.233338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23687): Launched 12:46:59.531823 run osmo-stp_10.42.42.5(pid=23688): Launched 12:46:59.645956 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:00.161116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23690): Launched 12:47:00.459268 run osmo-msc_10.42.42.6(pid=23691): Launched 12:47:00.625919 run osmo-stp_10.42.42.5(pid=23688): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23688)] 12:47:00.752469 run osmo-stp_10.42.42.5(pid=23688): stdout: | (launched: 2022-12-14_12:46:59.476641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:00.899084 run osmo-stp_10.42.42.5(pid=23688): stderr: | [0;m[38;5;43m20221214124659646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124659647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124659647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124659647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124659648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124659648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124659648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:01.027439 run osmo-stp_10.42.42.5(pid=23688): stdout: | (launched: 2022-12-14_12:46:59.476641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:01.149275 run osmo-stp_10.42.42.5(pid=23688): stderr: | [0;m[38;5;43m20221214124659646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124659647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124659647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124659647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124659648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124659648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124659648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:01.294512 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23688): Process ended prematurely: osmo-stp_10.42.42.5(pid=23688) [trial-2404↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23688)] [trial-2404↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 12:47:01.303643 tst handover.py:18: Test FAILED (6.3 sec) 12:47:01.330535 run osmo-hlr_10.42.42.2(pid=23685): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23685)] 12:47:01.381402 run osmo-hlr_10.42.42.2(pid=23685): stdout: | (launched: 2022-12-14_12:46:58.564894) 12:47:01.432622 run osmo-hlr_10.42.42.2(pid=23685): stderr: | [0;m[1;31m20221214124658737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124658737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124658737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124658737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124658738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124658738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124658750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124658761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124658761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124658761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:01.504582 run osmo-msc_10.42.42.6(pid=23691): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23691)] 12:47:01.552628 run osmo-msc_10.42.42.6(pid=23691): stdout: | (launched: 2022-12-14_12:47:00.404052) 12:47:01.603608 run osmo-msc_10.42.42.6(pid=23691): stderr: | [0;m[38;5;43m20221214124700676 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124700676 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc8ac42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124700676 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124700676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124700677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124700677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124700679 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124700679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124700679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124700679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:01.654868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23684): Terminating (SIGTERM) 12:47:01.697110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23687): Terminating (SIGTERM) 12:47:01.739965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23690): Terminating (SIGTERM) 12:47:01.782005 --- ParallelTerminationStrategy: PID 23684 died... 12:47:01.802757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23684): Terminated: ok {rc=0} 12:47:01.849141 --- ParallelTerminationStrategy: PID 23687 died... 12:47:01.869763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23687): Terminated: ok {rc=0} 12:47:01.915755 --- ParallelTerminationStrategy: PID 23690 died... 12:47:01.936340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23690): Terminated: ok {rc=0} 12:47:02.023749 bus /sierra_3: Setting Powered False 12:47:03.118596 bus /sierra_3: Setting Powered False 12:47:04.232551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 12:47:05.469922 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:05.476359 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:47:05.526320 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:47:05.553394 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:47:05.605655 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:47:05.653915 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:47:05.679976 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:47:06.233761 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 12:47:06.239236 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:47:06.250630 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:47:06.294851 tst handover.py: using LAC 41006 12:47:06.413440 tst handover.py: using RAC 206 12:47:06.531554 tst handover.py: using CellId 41006 12:47:06.647517 tst handover.py: using BVCI 41007 12:47:06.755920 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:47:06.802551 tst handover.py: using LAC 41007 12:47:06.921060 tst handover.py: using RAC 207 12:47:07.037635 tst handover.py: using CellId 41007 12:47:07.164093 tst handover.py: using BVCI 41008 12:47:07.272636 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:47:07.283339 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:47:07.293943 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:47:07.304506 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:47:07.315295 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:47:07.326184 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:47:07.442884 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:47:07.557732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:07.992611 run create_hlr_db(pid=23696): Launched 12:47:08.105349 bus /sierra_2: Setting Powered False 12:47:09.165215 run create_hlr_db(pid=23696): Terminated: ok {rc=0} 12:47:09.574931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23698): Launched 12:47:09.896235 run osmo-hlr_10.42.42.2(pid=23699): Launched 12:47:10.018506 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:10.540722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23701): Launched 12:47:10.860104 run osmo-stp_10.42.42.5(pid=23702): Launched 12:47:10.982141 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:11.532941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23704): Launched 12:47:11.853635 run osmo-msc_10.42.42.6(pid=23705): Launched 12:47:12.032342 run osmo-stp_10.42.42.5(pid=23702): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23702)] 12:47:12.167702 run osmo-stp_10.42.42.5(pid=23702): stdout: | (launched: 2022-12-14_12:47:10.801738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:12.303252 run osmo-stp_10.42.42.5(pid=23702): stderr: | [0;m[38;5;43m20221214124710996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124710996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124710997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124710997 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124710998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124710998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124710998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:12.437772 run osmo-stp_10.42.42.5(pid=23702): stdout: | (launched: 2022-12-14_12:47:10.801738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:12.565126 run osmo-stp_10.42.42.5(pid=23702): stderr: | [0;m[38;5;43m20221214124710996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124710996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124710997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124710997 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124710998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124710998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124710998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:12.717804 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23702): Process ended prematurely: osmo-stp_10.42.42.5(pid=23702) [trial-2404↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23702)] [trial-2404↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 12:47:12.726810 tst handover.py:18: Test FAILED (6.5 sec) 12:47:12.753875 run osmo-hlr_10.42.42.2(pid=23699): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23699)] 12:47:12.803941 run osmo-hlr_10.42.42.2(pid=23699): stdout: | (launched: 2022-12-14_12:47:09.837699) 12:47:12.855531 run osmo-hlr_10.42.42.2(pid=23699): stderr: | [0;m[1;31m20221214124710039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124710039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124710039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124710039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124710039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124710039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124710054 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124710064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124710064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124710064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:12.927001 run osmo-msc_10.42.42.6(pid=23705): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23705)] 12:47:12.976472 run osmo-msc_10.42.42.6(pid=23705): stdout: | (launched: 2022-12-14_12:47:11.794804) 12:47:13.028361 run osmo-msc_10.42.42.6(pid=23705): stderr: | [0;m[38;5;43m20221214124712114 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124712114 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f698c057c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124712115 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124712115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124712115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124712115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124712117 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124712117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124712117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124712117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:13.080052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23698): Terminating (SIGTERM) 12:47:13.121301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23701): Terminating (SIGTERM) 12:47:13.162553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23704): Terminating (SIGTERM) 12:47:13.204136 --- ParallelTerminationStrategy: PID 23698 died... 12:47:13.224107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23698): Terminated: ok {rc=0} 12:47:13.270232 --- ParallelTerminationStrategy: PID 23701 died... 12:47:13.289843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23701): Terminated: ok {rc=0} 12:47:13.335607 --- ParallelTerminationStrategy: PID 23704 died... 12:47:13.355293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23704): Terminated: ok {rc=0} 12:47:13.442882 bus /sierra_3: Setting Powered False 12:47:14.540471 bus /sierra_3: Setting Powered False 12:47:15.656337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 12:47:16.954968 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:16.961471 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:47:17.013569 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:47:17.041553 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:47:17.097234 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:47:17.157273 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:47:17.185515 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:47:17.716722 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 12:47:17.722753 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:47:17.734025 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:47:17.767374 tst handover.py: using LAC 41008 12:47:17.886164 tst handover.py: using RAC 208 12:47:18.002893 tst handover.py: using CellId 41008 12:47:18.121347 tst handover.py: using BVCI 41009 12:47:18.229621 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:47:18.276323 tst handover.py: using LAC 41009 12:47:18.394758 tst handover.py: using RAC 209 12:47:18.512088 tst handover.py: using CellId 41009 12:47:18.640828 tst handover.py: using BVCI 41010 12:47:18.759478 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:47:18.771134 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:47:18.782171 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:47:18.793149 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:47:18.805048 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:47:18.816547 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:47:18.936295 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:47:19.055902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:19.495121 run create_hlr_db(pid=23710): Launched 12:47:19.611358 bus /sierra_2: Setting Powered False 12:47:20.670943 run create_hlr_db(pid=23710): Terminated: ok {rc=0} 12:47:21.083832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23712): Launched 12:47:21.405499 run osmo-hlr_10.42.42.2(pid=23713): Launched 12:47:21.527148 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:22.052374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23715): Launched 12:47:22.371853 run osmo-stp_10.42.42.5(pid=23716): Launched 12:47:22.493908 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:23.046877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23718): Launched 12:47:23.368448 run osmo-msc_10.42.42.6(pid=23719): Launched 12:47:23.546883 run osmo-stp_10.42.42.5(pid=23716): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23716)] 12:47:23.681446 run osmo-stp_10.42.42.5(pid=23716): stdout: | (launched: 2022-12-14_12:47:22.313615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:23.816931 run osmo-stp_10.42.42.5(pid=23716): stderr: | [0;m[38;5;43m20221214124722504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124722504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124722505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124722505 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124722506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124722506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124722506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:23.951873 run osmo-stp_10.42.42.5(pid=23716): stdout: | (launched: 2022-12-14_12:47:22.313615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:24.079062 run osmo-stp_10.42.42.5(pid=23716): stderr: | [0;m[38;5;43m20221214124722504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124722504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124722505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124722505 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124722506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124722506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124722506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:24.231740 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23716): Process ended prematurely: osmo-stp_10.42.42.5(pid=23716) [trial-2404↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23716)] [trial-2404↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 12:47:24.240897 tst handover.py:18: Test FAILED (6.5 sec) 12:47:24.268268 run osmo-hlr_10.42.42.2(pid=23713): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23713)] 12:47:24.317832 run osmo-hlr_10.42.42.2(pid=23713): stdout: | (launched: 2022-12-14_12:47:21.346777) 12:47:24.369360 run osmo-hlr_10.42.42.2(pid=23713): stderr: | [0;m[1;31m20221214124721546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124721546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124721546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124721546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124721546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124721546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124721558 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124721569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124721569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124721569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:24.440897 run osmo-msc_10.42.42.6(pid=23719): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23719)] 12:47:24.490347 run osmo-msc_10.42.42.6(pid=23719): stdout: | (launched: 2022-12-14_12:47:23.309959) 12:47:24.541238 run osmo-msc_10.42.42.6(pid=23719): stderr: | [0;m[38;5;43m20221214124723633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124723633 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0d4ed1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124723633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124723633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124723633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124723633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124723635 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124723635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124723636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124723636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:24.592448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23712): Terminating (SIGTERM) 12:47:24.633810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23715): Terminating (SIGTERM) 12:47:24.675193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23718): Terminating (SIGTERM) 12:47:24.717111 --- ParallelTerminationStrategy: PID 23712 died... 12:47:24.737099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23712): Terminated: ok {rc=0} 12:47:24.783106 --- ParallelTerminationStrategy: PID 23715 died... 12:47:24.802713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23715): Terminated: ok {rc=0} 12:47:24.848929 --- ParallelTerminationStrategy: PID 23718 died... 12:47:24.868567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23718): Terminated: ok {rc=0} 12:47:24.955680 bus /sierra_3: Setting Powered False 12:47:26.053462 bus /sierra_3: Setting Powered False 12:47:27.171528 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:47:28.422622 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:28.427754 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:47:28.485468 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:47:28.511454 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:47:28.563407 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:47:28.623342 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:47:28.649547 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:47:29.200543 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:47:29.207051 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:47:29.218438 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:47:29.266599 tst handover.py: using LAC 41010 12:47:29.381569 tst handover.py: using RAC 210 12:47:29.506071 tst handover.py: using CellId 41010 12:47:29.629388 tst handover.py: using BVCI 41011 12:47:29.744596 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:47:29.788150 tst handover.py: using LAC 41011 12:47:29.914413 tst handover.py: using RAC 211 12:47:30.037885 tst handover.py: using CellId 41011 12:47:30.161802 tst handover.py: using BVCI 41012 12:47:30.270924 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:47:30.282027 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:47:30.292928 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:47:30.303914 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:47:30.315321 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:47:30.326578 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:47:30.446084 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:47:30.564696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:31.032449 run create_hlr_db(pid=23724): Launched 12:47:31.179548 bus /sierra_2: Setting Powered False 12:47:32.243971 run create_hlr_db(pid=23724): Terminated: ok {rc=0} 12:47:32.657479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23726): Launched 12:47:32.978153 run osmo-hlr_10.42.42.2(pid=23727): Launched 12:47:33.100545 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:33.628153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23729): Launched 12:47:33.949031 run osmo-stp_10.42.42.5(pid=23730): Launched 12:47:34.071048 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:34.623133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23732): Launched 12:47:34.943966 run osmo-msc_10.42.42.6(pid=23733): Launched 12:47:35.122810 run osmo-stp_10.42.42.5(pid=23730): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23730)] 12:47:35.258316 run osmo-stp_10.42.42.5(pid=23730): stdout: | (launched: 2022-12-14_12:47:33.890477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:35.393741 run osmo-stp_10.42.42.5(pid=23730): stderr: | [0;m[38;5;43m20221214124734083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124734083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124734083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124734083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124734086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124734086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124734086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:35.527882 run osmo-stp_10.42.42.5(pid=23730): stdout: | (launched: 2022-12-14_12:47:33.890477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:35.655150 run osmo-stp_10.42.42.5(pid=23730): stderr: | [0;m[38;5;43m20221214124734083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124734083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124734083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124734083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124734086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124734086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124734086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:35.807642 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23730): Process ended prematurely: osmo-stp_10.42.42.5(pid=23730) [trial-2404↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23730)] [trial-2404↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 12:47:35.816841 tst handover.py:18: Test FAILED (6.6 sec) 12:47:35.843966 run osmo-hlr_10.42.42.2(pid=23727): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23727)] 12:47:35.893667 run osmo-hlr_10.42.42.2(pid=23727): stdout: | (launched: 2022-12-14_12:47:32.919999) 12:47:35.944834 run osmo-hlr_10.42.42.2(pid=23727): stderr: | [0;m[1;31m20221214124733116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124733116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124733116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124733116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124733116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124733116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124733128 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124733136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124733137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124733137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:36.016348 run osmo-msc_10.42.42.6(pid=23733): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23733)] 12:47:36.065891 run osmo-msc_10.42.42.6(pid=23733): stdout: | (launched: 2022-12-14_12:47:34.885229) 12:47:36.117189 run osmo-msc_10.42.42.6(pid=23733): stderr: | [0;m[38;5;43m20221214124735206 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124735206 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5f6285bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124735206 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124735206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124735206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124735206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124735208 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124735209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124735209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124735209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:36.168747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23726): Terminating (SIGTERM) 12:47:36.209979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23729): Terminating (SIGTERM) 12:47:36.251214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23732): Terminating (SIGTERM) 12:47:36.292646 --- ParallelTerminationStrategy: PID 23726 died... 12:47:36.312495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23726): Terminated: ok {rc=0} 12:47:36.358269 --- ParallelTerminationStrategy: PID 23729 died... 12:47:36.377502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23729): Terminated: ok {rc=0} 12:47:36.422836 --- ParallelTerminationStrategy: PID 23732 died... 12:47:36.442235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23732): Terminated: ok {rc=0} 12:47:36.528390 bus /sierra_3: Setting Powered False 12:47:37.626199 bus /sierra_3: Setting Powered False 12:47:38.741886 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:47:40.004829 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:40.010122 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:47:40.072443 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:47:40.098520 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:47:40.150479 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:47:40.216431 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:47:40.243661 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:47:40.788704 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:47:40.794610 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:47:40.805980 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:47:40.852812 tst handover.py: using LAC 41012 12:47:40.970254 tst handover.py: using RAC 212 12:47:41.089395 tst handover.py: using CellId 41012 12:47:41.216208 tst handover.py: using BVCI 41013 12:47:41.325256 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:47:41.376375 tst handover.py: using LAC 41013 12:47:41.492177 tst handover.py: using RAC 213 12:47:41.607309 tst handover.py: using CellId 41013 12:47:41.721817 tst handover.py: using BVCI 41014 12:47:41.829864 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:47:41.840917 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:47:41.851705 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:47:41.862443 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:47:41.873631 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:47:41.884866 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:47:42.001051 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:47:42.118718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:42.555880 run create_hlr_db(pid=23738): Launched 12:47:42.670135 bus /sierra_2: Setting Powered False 12:47:43.729984 run create_hlr_db(pid=23738): Terminated: ok {rc=0} 12:47:44.141404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23740): Launched 12:47:44.461118 run osmo-hlr_10.42.42.2(pid=23741): Launched 12:47:44.582998 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:45.108375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23743): Launched 12:47:45.428573 run osmo-stp_10.42.42.5(pid=23744): Launched 12:47:45.552255 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:46.139203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23746): Launched 12:47:46.482234 run osmo-msc_10.42.42.6(pid=23747): Launched 12:47:46.779473 run osmo-stp_10.42.42.5(pid=23744): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23744)] 12:47:47.105174 run osmo-stp_10.42.42.5(pid=23744): stdout: | (launched: 2022-12-14_12:47:45.370015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:47.421531 run osmo-stp_10.42.42.5(pid=23744): stderr: | [0;m[38;5;43m20221214124745564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124745565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124745565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124745565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124745566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124745566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124745566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:47.557280 run osmo-stp_10.42.42.5(pid=23744): stdout: | (launched: 2022-12-14_12:47:45.370015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:47.684795 run osmo-stp_10.42.42.5(pid=23744): stderr: | [0;m[38;5;43m20221214124745564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124745565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124745565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124745565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124745566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124745566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124745566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:47.837876 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23744): Process ended prematurely: osmo-stp_10.42.42.5(pid=23744) [trial-2404↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23744)] [trial-2404↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 12:47:47.846742 tst handover.py:18: Test FAILED (7.0 sec) 12:47:47.874148 run osmo-hlr_10.42.42.2(pid=23741): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23741)] 12:47:47.923710 run osmo-hlr_10.42.42.2(pid=23741): stdout: | (launched: 2022-12-14_12:47:44.402529) 12:47:47.975019 run osmo-hlr_10.42.42.2(pid=23741): stderr: | [0;m[1;31m20221214124744602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124744602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124744602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124744602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124744602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124744602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124744614 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124744622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124744622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124744623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:48.046744 run osmo-msc_10.42.42.6(pid=23747): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23747)] 12:47:48.098876 run osmo-msc_10.42.42.6(pid=23747): stdout: | (launched: 2022-12-14_12:47:46.411300) 12:47:48.148547 run osmo-msc_10.42.42.6(pid=23747): stderr: | [0;m[38;5;43m20221214124747186 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124747186 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad6c7eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124747186 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124747187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124747187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124747188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124747193 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124747193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124747194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124747195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:48.197588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23740): Terminating (SIGTERM) 12:47:48.237196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23743): Terminating (SIGTERM) 12:47:48.277206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23746): Terminating (SIGTERM) 12:47:48.317153 --- ParallelTerminationStrategy: PID 23740 died... 12:47:48.336492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23740): Terminated: ok {rc=0} 12:47:48.380216 --- ParallelTerminationStrategy: PID 23743 died... 12:47:48.399030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23743): Terminated: ok {rc=0} 12:47:48.442793 --- ParallelTerminationStrategy: PID 23746 died... 12:47:48.461697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23746): Terminated: ok {rc=0} 12:47:48.547386 bus /sierra_3: Setting Powered False 12:47:49.645279 bus /sierra_3: Setting Powered False 12:47:50.757141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 12:47:52.030623 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:47:52.036091 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:47:52.087217 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:47:52.114228 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:47:52.166029 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:47:52.217475 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:47:52.244422 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:47:52.790656 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 12:47:52.796064 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:47:52.806912 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 12:47:52.853389 tst handover.py: using LAC 41014 12:47:52.970589 tst handover.py: using RAC 214 12:47:53.102129 tst handover.py: using CellId 41014 12:47:53.227258 tst handover.py: using BVCI 41015 12:47:53.343762 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 12:47:53.378068 tst handover.py: using LAC 41015 12:47:53.501899 tst handover.py: using RAC 215 12:47:53.625385 tst handover.py: using CellId 41015 12:47:53.748928 tst handover.py: using BVCI 41016 12:47:53.865125 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:47:53.876627 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:47:53.887714 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:47:53.898663 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:47:53.909730 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:47:53.920625 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 12:47:54.037800 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 12:47:54.156568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:47:54.625293 run create_hlr_db(pid=23752): Launched 12:47:54.754172 bus /sierra_2: Setting Powered False 12:47:55.817151 run create_hlr_db(pid=23752): Terminated: ok {rc=0} 12:47:56.236476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23754): Launched 12:47:56.555611 run osmo-hlr_10.42.42.2(pid=23755): Launched 12:47:56.677491 run osmo-stp_10.42.42.5: Starting osmo-stp 12:47:57.202121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23757): Launched 12:47:57.522934 run osmo-stp_10.42.42.5(pid=23758): Launched 12:47:57.644867 run osmo-msc_10.42.42.6: Starting osmo-msc 12:47:58.197894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23760): Launched 12:47:58.517297 run osmo-msc_10.42.42.6(pid=23761): Launched 12:47:58.695215 run osmo-stp_10.42.42.5(pid=23758): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23758)] 12:47:58.830628 run osmo-stp_10.42.42.5(pid=23758): stdout: | (launched: 2022-12-14_12:47:57.463856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:58.966305 run osmo-stp_10.42.42.5(pid=23758): stderr: | [0;m[38;5;43m20221214124757657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124757657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124757658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124757658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124757660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124757661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124757661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:59.100730 run osmo-stp_10.42.42.5(pid=23758): stdout: | (launched: 2022-12-14_12:47:57.463856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:47:59.227797 run osmo-stp_10.42.42.5(pid=23758): stderr: | [0;m[38;5;43m20221214124757657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124757657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124757658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124757658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124757660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124757661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124757661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:47:59.380431 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23758): Process ended prematurely: osmo-stp_10.42.42.5(pid=23758) [trial-2404↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23758)] [trial-2404↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 12:47:59.389458 tst handover.py:18: Test FAILED (6.6 sec) 12:47:59.416824 run osmo-hlr_10.42.42.2(pid=23755): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23755)] 12:47:59.466533 run osmo-hlr_10.42.42.2(pid=23755): stdout: | (launched: 2022-12-14_12:47:56.497025) 12:47:59.517859 run osmo-hlr_10.42.42.2(pid=23755): stderr: | [0;m[1;31m20221214124756697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124756697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124756697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124756697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124756697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124756697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124756709 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124756717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124756718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124756718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:47:59.589366 run osmo-msc_10.42.42.6(pid=23761): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23761)] 12:47:59.638580 run osmo-msc_10.42.42.6(pid=23761): stdout: | (launched: 2022-12-14_12:47:58.458595) 12:47:59.689521 run osmo-msc_10.42.42.6(pid=23761): stderr: | [0;m[38;5;43m20221214124758782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124758783 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0ac63bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124758783 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124758783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124758783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124758783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124758785 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124758785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124758785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124758786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:47:59.740715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23754): Terminating (SIGTERM) 12:47:59.781884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23757): Terminating (SIGTERM) 12:47:59.823316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23760): Terminating (SIGTERM) 12:47:59.864817 --- ParallelTerminationStrategy: PID 23754 died... 12:47:59.884714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23754): Terminated: ok {rc=0} 12:47:59.930387 --- ParallelTerminationStrategy: PID 23757 died... 12:47:59.949694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23757): Terminated: ok {rc=0} 12:47:59.995186 --- ParallelTerminationStrategy: PID 23760 died... 12:48:00.014584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23760): Terminated: ok {rc=0} 12:48:00.101506 bus /sierra_3: Setting Powered False 12:48:01.204012 bus /sierra_3: Setting Powered False 12:48:02.335920 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 12:48:03.597391 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:03.602809 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:48:03.665872 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:48:03.692813 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:48:03.743075 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:48:03.806989 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:48:03.834260 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:48:04.382406 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 12:48:04.387734 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:04.398657 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:48:04.445402 tst handover.py: using LAC 41016 12:48:04.569520 tst handover.py: using RAC 216 12:48:04.692242 tst handover.py: using CellId 41016 12:48:04.818904 tst handover.py: using BVCI 41017 12:48:04.935069 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:48:04.982760 tst handover.py: using LAC 41017 12:48:05.099485 tst handover.py: using RAC 217 12:48:05.214654 tst handover.py: using CellId 41017 12:48:05.329947 tst handover.py: using BVCI 41018 12:48:05.438044 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:05.448819 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:05.459700 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:05.470323 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:05.481203 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:05.492274 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:48:05.611178 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:48:05.725448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:06.160719 run create_hlr_db(pid=23766): Launched 12:48:06.274483 bus /sierra_2: Setting Powered False 12:48:07.333923 run create_hlr_db(pid=23766): Terminated: ok {rc=0} 12:48:07.745841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23768): Launched 12:48:08.067174 run osmo-hlr_10.42.42.2(pid=23769): Launched 12:48:08.189186 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:08.715792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23771): Launched 12:48:09.037726 run osmo-stp_10.42.42.5(pid=23772): Launched 12:48:09.160088 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:09.716512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23774): Launched 12:48:10.037696 run osmo-msc_10.42.42.6(pid=23775): Launched 12:48:10.215827 run osmo-stp_10.42.42.5(pid=23772): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23772)] 12:48:10.351136 run osmo-stp_10.42.42.5(pid=23772): stdout: | (launched: 2022-12-14_12:48:08.978710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:10.486674 run osmo-stp_10.42.42.5(pid=23772): stderr: | [0;m[38;5;43m20221214124809171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124809171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124809171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124809172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124809174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124809174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124809174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:10.621364 run osmo-stp_10.42.42.5(pid=23772): stdout: | (launched: 2022-12-14_12:48:08.978710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:10.749086 run osmo-stp_10.42.42.5(pid=23772): stderr: | [0;m[38;5;43m20221214124809171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124809171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124809171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124809172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124809174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124809174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124809174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:10.902457 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23772): Process ended prematurely: osmo-stp_10.42.42.5(pid=23772) [trial-2404↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23772)] [trial-2404↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 12:48:10.911119 tst handover.py:18: Test FAILED (6.5 sec) 12:48:10.938087 run osmo-hlr_10.42.42.2(pid=23769): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23769)] 12:48:10.987593 run osmo-hlr_10.42.42.2(pid=23769): stdout: | (launched: 2022-12-14_12:48:08.008500) 12:48:11.038654 run osmo-hlr_10.42.42.2(pid=23769): stderr: | [0;m[1;31m20221214124808208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124808208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124808208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124808208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124808208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124808208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124808223 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124808231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124808232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124808232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:11.109893 run osmo-msc_10.42.42.6(pid=23775): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23775)] 12:48:11.159051 run osmo-msc_10.42.42.6(pid=23775): stdout: | (launched: 2022-12-14_12:48:09.979011) 12:48:11.210524 run osmo-msc_10.42.42.6(pid=23775): stderr: | [0;m[38;5;43m20221214124810299 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124810299 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f795494dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124810299 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124810299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124810300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124810300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124810301 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124810302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124810302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124810302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:11.262314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23768): Terminating (SIGTERM) 12:48:11.303707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23771): Terminating (SIGTERM) 12:48:11.345254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23774): Terminating (SIGTERM) 12:48:11.386964 --- ParallelTerminationStrategy: PID 23768 died... 12:48:11.406862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23768): Terminated: ok {rc=0} 12:48:11.452665 --- ParallelTerminationStrategy: PID 23771 died... 12:48:11.472353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23771): Terminated: ok {rc=0} 12:48:11.518126 --- ParallelTerminationStrategy: PID 23774 died... 12:48:11.537659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23774): Terminated: ok {rc=0} 12:48:11.624387 bus /sierra_3: Setting Powered False 12:48:12.722229 bus /sierra_3: Setting Powered False 12:48:13.837175 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 12:48:15.102822 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:15.108028 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:48:15.170266 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:48:15.196368 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:48:15.247892 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:48:15.310185 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:48:15.336248 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:48:15.902895 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 12:48:15.912888 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:48:15.925485 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:48:15.980494 tst handover.py: using LAC 41018 12:48:16.131642 tst handover.py: using RAC 218 12:48:16.260251 tst handover.py: using CellId 41018 12:48:16.429310 tst handover.py: using BVCI 41019 12:48:16.573751 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:48:16.621140 tst handover.py: using LAC 41019 12:48:16.765245 tst handover.py: using RAC 219 12:48:16.921181 tst handover.py: using CellId 41019 12:48:17.049259 tst handover.py: using BVCI 41020 12:48:17.195834 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:48:17.210909 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:48:17.224161 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:48:17.238112 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:48:17.249914 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:48:17.261782 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:48:17.384722 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:48:17.501689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:17.940108 run create_hlr_db(pid=23780): Launched 12:48:18.053534 bus /sierra_2: Setting Powered False 12:48:19.113303 run create_hlr_db(pid=23780): Terminated: ok {rc=0} 12:48:19.524820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23782): Launched 12:48:19.845773 run osmo-hlr_10.42.42.2(pid=23783): Launched 12:48:19.967977 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:20.492514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23785): Launched 12:48:20.812073 run osmo-stp_10.42.42.5(pid=23786): Launched 12:48:20.934593 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:21.486436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23788): Launched 12:48:21.807151 run osmo-msc_10.42.42.6(pid=23789): Launched 12:48:21.984908 run osmo-stp_10.42.42.5(pid=23786): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23786)] 12:48:22.119821 run osmo-stp_10.42.42.5(pid=23786): stdout: | (launched: 2022-12-14_12:48:20.753410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:22.254938 run osmo-stp_10.42.42.5(pid=23786): stderr: | [0;m[38;5;43m20221214124820944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124820945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124820945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124820945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124820946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124820946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124820946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:22.389327 run osmo-stp_10.42.42.5(pid=23786): stdout: | (launched: 2022-12-14_12:48:20.753410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:22.516458 run osmo-stp_10.42.42.5(pid=23786): stderr: | [0;m[38;5;43m20221214124820944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124820945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124820945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124820945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124820946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124820946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124820946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:22.669026 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23786): Process ended prematurely: osmo-stp_10.42.42.5(pid=23786) [trial-2404↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23786)] [trial-2404↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 12:48:22.677817 tst handover.py:18: Test FAILED (6.8 sec) 12:48:22.705080 run osmo-hlr_10.42.42.2(pid=23783): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23783)] 12:48:22.755006 run osmo-hlr_10.42.42.2(pid=23783): stdout: | (launched: 2022-12-14_12:48:19.787096) 12:48:22.806411 run osmo-hlr_10.42.42.2(pid=23783): stderr: | [0;m[1;31m20221214124819985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124819985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124819985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124819985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124819985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124819985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124820000 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124820010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124820010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124820010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:22.878230 run osmo-msc_10.42.42.6(pid=23789): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23789)] 12:48:22.927784 run osmo-msc_10.42.42.6(pid=23789): stdout: | (launched: 2022-12-14_12:48:21.748197) 12:48:22.978729 run osmo-msc_10.42.42.6(pid=23789): stderr: | [0;m[38;5;43m20221214124822069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124822069 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2d9f48dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124822069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124822069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124822069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124822069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124822073 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124822073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124822073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124822073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:23.030293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23782): Terminating (SIGTERM) 12:48:23.071494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23785): Terminating (SIGTERM) 12:48:23.112842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23788): Terminating (SIGTERM) 12:48:23.154981 --- ParallelTerminationStrategy: PID 23782 died... 12:48:23.174918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23782): Terminated: ok {rc=0} 12:48:23.220913 --- ParallelTerminationStrategy: PID 23785 died... 12:48:23.240533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23785): Terminated: ok {rc=0} 12:48:23.286140 --- ParallelTerminationStrategy: PID 23788 died... 12:48:23.305736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23788): Terminated: ok {rc=0} 12:48:23.392362 bus /sierra_3: Setting Powered False 12:48:24.491995 bus /sierra_3: Setting Powered False 12:48:25.606733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:48:26.870320 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:26.875423 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:48:26.934217 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:48:26.960398 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:48:27.015845 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:48:27.076835 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:48:27.103366 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:48:27.655058 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:48:27.660543 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:48:27.672365 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:48:27.717729 tst handover.py: using LAC 41020 12:48:27.844615 tst handover.py: using RAC 220 12:48:27.969451 tst handover.py: using CellId 41020 12:48:28.093349 tst handover.py: using BVCI 41021 12:48:28.209351 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:48:28.258049 tst handover.py: using LAC 41021 12:48:28.381817 tst handover.py: using RAC 221 12:48:28.506111 tst handover.py: using CellId 41021 12:48:28.629427 tst handover.py: using BVCI 41022 12:48:28.747570 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:48:28.759166 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:48:28.770576 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:48:28.782058 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:48:28.793582 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:48:28.804893 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:48:28.921310 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:48:29.035800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:29.473644 run create_hlr_db(pid=23794): Launched 12:48:29.588753 bus /sierra_2: Setting Powered False 12:48:30.649197 run create_hlr_db(pid=23794): Terminated: ok {rc=0} 12:48:31.074115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23796): Launched 12:48:31.397260 run osmo-hlr_10.42.42.2(pid=23797): Launched 12:48:31.636360 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:32.297196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23799): Launched 12:48:32.610708 run osmo-stp_10.42.42.5(pid=23800): Launched 12:48:32.725387 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:33.243107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23802): Launched 12:48:33.542214 run osmo-msc_10.42.42.6(pid=23803): Launched 12:48:33.708646 run osmo-stp_10.42.42.5(pid=23800): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23800)] 12:48:33.835593 run osmo-stp_10.42.42.5(pid=23800): stdout: | (launched: 2022-12-14_12:48:32.555966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:33.961980 run osmo-stp_10.42.42.5(pid=23800): stderr: | [0;m[38;5;43m20221214124832723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124832723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124832724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124832724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124832725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124832725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124832725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:34.085974 run osmo-stp_10.42.42.5(pid=23800): stdout: | (launched: 2022-12-14_12:48:32.555966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:34.204597 run osmo-stp_10.42.42.5(pid=23800): stderr: | [0;m[38;5;43m20221214124832723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124832723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124832724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124832724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124832725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124832725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124832725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:34.346233 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23800): Process ended prematurely: osmo-stp_10.42.42.5(pid=23800) [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23800)] [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 12:48:34.354422 tst handover.py:18: Test FAILED (6.7 sec) 12:48:34.380187 run osmo-hlr_10.42.42.2(pid=23797): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23797)] 12:48:34.428763 run osmo-hlr_10.42.42.2(pid=23797): stdout: | (launched: 2022-12-14_12:48:31.333825) 12:48:34.477929 run osmo-hlr_10.42.42.2(pid=23797): stderr: | [0;m[1;31m20221214124831561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124831561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124831561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124831562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124831562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124831562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124831583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124831593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124831594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124831594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:34.546768 run osmo-msc_10.42.42.6(pid=23803): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23803)] 12:48:34.593754 run osmo-msc_10.42.42.6(pid=23803): stdout: | (launched: 2022-12-14_12:48:33.486597) 12:48:34.642286 run osmo-msc_10.42.42.6(pid=23803): stderr: | [0;m[38;5;43m20221214124833759 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124833760 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f005540dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124833760 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124833760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124833760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124833760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124833762 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124833762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124833762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124833762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:34.691329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23796): Terminating (SIGTERM) 12:48:34.731750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23799): Terminating (SIGTERM) 12:48:34.772524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23802): Terminating (SIGTERM) 12:48:34.814680 --- ParallelTerminationStrategy: PID 23796 died... 12:48:34.857345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23796): Terminated: ok {rc=0} 12:48:34.902804 --- ParallelTerminationStrategy: PID 23799 died... 12:48:34.921374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23799): Terminated: ok {rc=0} 12:48:34.966254 --- ParallelTerminationStrategy: PID 23802 died... 12:48:34.985324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23802): Terminated: ok {rc=0} 12:48:35.070844 bus /sierra_3: Setting Powered False 12:48:36.168868 bus /sierra_3: Setting Powered False 12:48:37.283205 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 12:48:38.549075 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:38.554167 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:48:38.600432 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:48:38.626608 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:48:38.678322 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:48:38.725590 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:48:38.751730 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:48:39.300901 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 12:48:39.306290 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:48:39.317422 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 12:48:39.361232 tst handover.py: using LAC 41022 12:48:39.487902 tst handover.py: using RAC 222 12:48:39.613357 tst handover.py: using CellId 41022 12:48:39.740026 tst handover.py: using BVCI 41023 12:48:39.858339 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 12:48:39.894540 tst handover.py: using LAC 41023 12:48:40.019965 tst handover.py: using RAC 223 12:48:40.149616 tst handover.py: using CellId 41023 12:48:40.273688 tst handover.py: using BVCI 41024 12:48:40.390050 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:48:40.401449 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:48:40.412515 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:48:40.423842 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:48:40.435083 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:48:40.446431 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 12:48:40.568581 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 12:48:40.689586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:41.158450 run create_hlr_db(pid=23808): Launched 12:48:41.287107 bus /sierra_2: Setting Powered False 12:48:42.351669 run create_hlr_db(pid=23808): Terminated: ok {rc=0} 12:48:42.771703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23810): Launched 12:48:43.093154 run osmo-hlr_10.42.42.2(pid=23811): Launched 12:48:43.215385 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:43.739702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23813): Launched 12:48:44.061404 run osmo-stp_10.42.42.5(pid=23814): Launched 12:48:44.183251 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:44.736286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23816): Launched 12:48:45.058273 run osmo-msc_10.42.42.6(pid=23817): Launched 12:48:45.235847 run osmo-stp_10.42.42.5(pid=23814): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23814)] 12:48:45.370331 run osmo-stp_10.42.42.5(pid=23814): stdout: | (launched: 2022-12-14_12:48:44.002747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:45.505517 run osmo-stp_10.42.42.5(pid=23814): stderr: | [0;m[38;5;43m20221214124844194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124844195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124844195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124844195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124844196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124844196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124844196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:45.639977 run osmo-stp_10.42.42.5(pid=23814): stdout: | (launched: 2022-12-14_12:48:44.002747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:45.767578 run osmo-stp_10.42.42.5(pid=23814): stderr: | [0;m[38;5;43m20221214124844194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124844195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124844195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124844195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124844196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124844196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124844196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:45.940705 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23814): Process ended prematurely: osmo-stp_10.42.42.5(pid=23814) [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23814)] [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 12:48:45.950055 tst handover.py:18: Test FAILED (6.6 sec) 12:48:45.977431 run osmo-hlr_10.42.42.2(pid=23811): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23811)] 12:48:46.028251 run osmo-hlr_10.42.42.2(pid=23811): stdout: | (launched: 2022-12-14_12:48:43.034408) 12:48:46.081923 run osmo-hlr_10.42.42.2(pid=23811): stderr: | [0;m[1;31m20221214124843231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124843231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124843231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124843231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124843232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124843232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124843244 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124843253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124843253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124843253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:46.153230 run osmo-msc_10.42.42.6(pid=23817): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23817)] 12:48:46.201782 run osmo-msc_10.42.42.6(pid=23817): stdout: | (launched: 2022-12-14_12:48:44.998555) 12:48:46.254334 run osmo-msc_10.42.42.6(pid=23817): stderr: | [0;m[38;5;43m20221214124845319 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124845319 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9655f19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124845319 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124845319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124845320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124845320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124845321 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124845322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124845322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124845322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:46.305813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23810): Terminating (SIGTERM) 12:48:46.348314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23813): Terminating (SIGTERM) 12:48:46.391564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23816): Terminating (SIGTERM) 12:48:46.435620 --- ParallelTerminationStrategy: PID 23810 died... 12:48:46.457804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23810): Terminated: ok {rc=0} 12:48:46.505282 --- ParallelTerminationStrategy: PID 23813 died... 12:48:46.526490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23813): Terminated: ok {rc=0} 12:48:46.574347 --- ParallelTerminationStrategy: PID 23816 died... 12:48:46.595287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23816): Terminated: ok {rc=0} 12:48:46.683485 bus /sierra_3: Setting Powered False 12:48:47.780029 bus /sierra_3: Setting Powered False 12:48:48.895009 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 12:48:50.150551 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:50.156121 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:48:50.215969 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:48:50.243065 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:48:50.296277 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:48:50.357691 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:48:50.384770 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:48:50.936733 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 12:48:50.942363 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:50.953966 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:48:50.999232 tst handover.py: using LAC 41024 12:48:51.127232 tst handover.py: using RAC 224 12:48:51.253755 tst handover.py: using CellId 41024 12:48:51.384575 tst handover.py: using BVCI 41025 12:48:51.502496 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:48:51.550697 tst handover.py: using LAC 41025 12:48:51.676243 tst handover.py: using RAC 225 12:48:51.801987 tst handover.py: using CellId 41025 12:48:51.926475 tst handover.py: using BVCI 41026 12:48:52.044113 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:52.055553 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:52.066865 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:52.078258 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:52.089710 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:48:52.101132 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:48:52.219909 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:48:52.340230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:52.810113 run create_hlr_db(pid=23822): Launched 12:48:52.939845 bus /sierra_2: Setting Powered False 12:48:54.002949 run create_hlr_db(pid=23822): Terminated: ok {rc=0} 12:48:54.423515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23824): Launched 12:48:54.744537 run osmo-hlr_10.42.42.2(pid=23825): Launched 12:48:54.866975 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:55.396938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23827): Launched 12:48:55.716747 run osmo-stp_10.42.42.5(pid=23828): Launched 12:48:55.838994 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:56.391021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23830): Launched 12:48:56.710932 run osmo-msc_10.42.42.6(pid=23831): Launched 12:48:56.888862 run osmo-stp_10.42.42.5(pid=23828): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23828)] 12:48:57.023583 run osmo-stp_10.42.42.5(pid=23828): stdout: | (launched: 2022-12-14_12:48:55.658109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:57.158571 run osmo-stp_10.42.42.5(pid=23828): stderr: | [0;m[38;5;43m20221214124855853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124855853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124855854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124855854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124855855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124855855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124855855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:57.293170 run osmo-stp_10.42.42.5(pid=23828): stdout: | (launched: 2022-12-14_12:48:55.658109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:57.420625 run osmo-stp_10.42.42.5(pid=23828): stderr: | [0;m[38;5;43m20221214124855853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124855853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124855854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124855854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124855855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124855855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124855855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:57.573370 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23828): Process ended prematurely: osmo-stp_10.42.42.5(pid=23828) [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23828)] [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 12:48:57.582409 tst handover.py:18: Test FAILED (6.6 sec) 12:48:57.609866 run osmo-hlr_10.42.42.2(pid=23825): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23825)] 12:48:57.659917 run osmo-hlr_10.42.42.2(pid=23825): stdout: | (launched: 2022-12-14_12:48:54.685950) 12:48:57.711367 run osmo-hlr_10.42.42.2(pid=23825): stderr: | [0;m[1;31m20221214124854885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124854885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124854885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124854885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124854885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124854885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124854898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124854908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124854908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124854908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:57.783310 run osmo-msc_10.42.42.6(pid=23831): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23831)] 12:48:57.832644 run osmo-msc_10.42.42.6(pid=23831): stdout: | (launched: 2022-12-14_12:48:56.652251) 12:48:57.884376 run osmo-msc_10.42.42.6(pid=23831): stderr: | [0;m[38;5;43m20221214124856974 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124856974 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7febf0080c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124856974 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124856974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124856974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124856974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124856976 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124856976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124856976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124856976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:57.935745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23824): Terminating (SIGTERM) 12:48:57.976757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23827): Terminating (SIGTERM) 12:48:58.018242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23830): Terminating (SIGTERM) 12:48:58.059855 --- ParallelTerminationStrategy: PID 23824 died... 12:48:58.079938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23824): Terminated: ok {rc=0} 12:48:58.126121 --- ParallelTerminationStrategy: PID 23827 died... 12:48:58.145662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23827): Terminated: ok {rc=0} 12:48:58.191274 --- ParallelTerminationStrategy: PID 23830 died... 12:48:58.210751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23830): Terminated: ok {rc=0} 12:48:58.297330 bus /sierra_3: Setting Powered False 12:48:59.396029 bus /sierra_3: Setting Powered False 12:49:00.509192 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 12:49:01.780676 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:01.786363 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:49:01.847374 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:49:01.875967 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:49:01.929895 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:49:02.012800 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:49:02.045723 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:49:02.568136 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 12:49:02.574820 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:02.587072 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:49:02.629925 tst handover.py: using LAC 41026 12:49:02.756284 tst handover.py: using RAC 226 12:49:02.882247 tst handover.py: using CellId 41026 12:49:03.009069 tst handover.py: using BVCI 41027 12:49:03.124913 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:49:03.173660 tst handover.py: using LAC 41027 12:49:03.298926 tst handover.py: using RAC 227 12:49:03.420212 tst handover.py: using CellId 41027 12:49:03.537284 tst handover.py: using BVCI 41028 12:49:03.645976 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:03.657007 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:03.667963 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:03.678754 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:03.689947 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:03.701272 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:49:03.821462 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:49:03.940281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:04.409933 run create_hlr_db(pid=23836): Launched 12:49:04.539525 bus /sierra_2: Setting Powered False 12:49:05.602847 run create_hlr_db(pid=23836): Terminated: ok {rc=0} 12:49:06.007122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23838): Launched 12:49:06.305816 run osmo-hlr_10.42.42.2(pid=23839): Launched 12:49:06.420018 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:06.907689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23841): Launched 12:49:07.205545 run osmo-stp_10.42.42.5(pid=23842): Launched 12:49:07.319359 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:07.834503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23844): Launched 12:49:08.133064 run osmo-msc_10.42.42.6(pid=23845): Launched 12:49:08.299774 run osmo-stp_10.42.42.5(pid=23842): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23842)] 12:49:08.427137 run osmo-stp_10.42.42.5(pid=23842): stdout: | (launched: 2022-12-14_12:49:07.150280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:08.553713 run osmo-stp_10.42.42.5(pid=23842): stderr: | [0;m[38;5;43m20221214124907320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124907320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124907321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124907321 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124907322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124907322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124907322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:08.677852 run osmo-stp_10.42.42.5(pid=23842): stdout: | (launched: 2022-12-14_12:49:07.150280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:08.796124 run osmo-stp_10.42.42.5(pid=23842): stderr: | [0;m[38;5;43m20221214124907320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124907320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124907321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124907321 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124907322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124907322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124907322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:08.939326 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23842): Process ended prematurely: osmo-stp_10.42.42.5(pid=23842) [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23842)] [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 12:49:08.947738 tst handover.py:18: Test FAILED (6.4 sec) 12:49:08.973770 run osmo-hlr_10.42.42.2(pid=23839): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23839)] 12:49:09.022359 run osmo-hlr_10.42.42.2(pid=23839): stdout: | (launched: 2022-12-14_12:49:06.250712) 12:49:09.071630 run osmo-hlr_10.42.42.2(pid=23839): stderr: | [0;m[1;31m20221214124906427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124906427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124906427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124906427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124906427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124906427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124906456 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124906465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124906465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124906465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:09.140430 run osmo-msc_10.42.42.6(pid=23845): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23845)] 12:49:09.187618 run osmo-msc_10.42.42.6(pid=23845): stdout: | (launched: 2022-12-14_12:49:08.077849) 12:49:09.236699 run osmo-msc_10.42.42.6(pid=23845): stderr: | [0;m[38;5;43m20221214124908347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124908347 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f88c1048c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124908347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124908347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124908348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124908348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124908350 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124908350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124908350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124908350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:09.286167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23838): Terminating (SIGTERM) 12:49:09.325743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23841): Terminating (SIGTERM) 12:49:09.365359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23844): Terminating (SIGTERM) 12:49:09.405257 --- ParallelTerminationStrategy: PID 23838 died... 12:49:09.424652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23838): Terminated: ok {rc=0} 12:49:09.468551 --- ParallelTerminationStrategy: PID 23841 died... 12:49:09.487518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23841): Terminated: ok {rc=0} 12:49:09.530965 --- ParallelTerminationStrategy: PID 23844 died... 12:49:09.549975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23844): Terminated: ok {rc=0} 12:49:09.635794 bus /sierra_3: Setting Powered False 12:49:10.734277 bus /sierra_3: Setting Powered False 12:49:11.847891 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 12:49:13.116844 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:13.122564 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:49:13.174378 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:49:13.201439 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:49:13.253079 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:49:13.303766 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:49:13.329868 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:49:13.885673 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 12:49:13.891270 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:49:13.902828 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 12:49:13.951230 tst handover.py: using LAC 41028 12:49:14.077307 tst handover.py: using RAC 228 12:49:14.204527 tst handover.py: using CellId 41028 12:49:14.329100 tst handover.py: using BVCI 41029 12:49:14.445211 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 12:49:14.481054 tst handover.py: using LAC 41029 12:49:14.605935 tst handover.py: using RAC 229 12:49:14.731312 tst handover.py: using CellId 41029 12:49:14.856657 tst handover.py: using BVCI 41030 12:49:14.973074 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:49:14.984508 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:49:14.995670 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:49:15.006949 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:49:15.018373 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:49:15.029793 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 12:49:15.147022 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 12:49:15.260856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:15.697595 run create_hlr_db(pid=23850): Launched 12:49:15.812645 bus /sierra_2: Setting Powered False 12:49:16.876217 run create_hlr_db(pid=23850): Terminated: ok {rc=0} 12:49:17.304816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23852): Launched 12:49:17.625906 run osmo-hlr_10.42.42.2(pid=23853): Launched 12:49:17.747046 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:18.270757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23855): Launched 12:49:18.590853 run osmo-stp_10.42.42.5(pid=23856): Launched 12:49:18.712369 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:19.267984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23858): Launched 12:49:19.590837 run osmo-msc_10.42.42.6(pid=23859): Launched 12:49:19.769184 run osmo-stp_10.42.42.5(pid=23856): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23856)] 12:49:19.904543 run osmo-stp_10.42.42.5(pid=23856): stdout: | (launched: 2022-12-14_12:49:18.532266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:20.040507 run osmo-stp_10.42.42.5(pid=23856): stderr: | [0;m[38;5;43m20221214124918724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124918724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124918724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124918724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124918727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124918727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124918727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:20.175055 run osmo-stp_10.42.42.5(pid=23856): stdout: | (launched: 2022-12-14_12:49:18.532266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:20.302163 run osmo-stp_10.42.42.5(pid=23856): stderr: | [0;m[38;5;43m20221214124918724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124918724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124918724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124918724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124918727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124918727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124918727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:20.454688 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23856): Process ended prematurely: osmo-stp_10.42.42.5(pid=23856) [trial-2404↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23856)] [trial-2404↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 12:49:20.463680 tst handover.py:18: Test FAILED (6.6 sec) 12:49:20.490849 run osmo-hlr_10.42.42.2(pid=23853): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23853)] 12:49:20.540479 run osmo-hlr_10.42.42.2(pid=23853): stdout: | (launched: 2022-12-14_12:49:17.567123) 12:49:20.591738 run osmo-hlr_10.42.42.2(pid=23853): stderr: | [0;m[1;31m20221214124917765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124917765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124917765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124917765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124917765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124917765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124917777 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124917785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124917786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124917786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:20.662630 run osmo-msc_10.42.42.6(pid=23859): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23859)] 12:49:20.711731 run osmo-msc_10.42.42.6(pid=23859): stdout: | (launched: 2022-12-14_12:49:19.530855) 12:49:20.762480 run osmo-msc_10.42.42.6(pid=23859): stderr: | [0;m[38;5;43m20221214124919855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124919855 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f888626ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124919855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124919855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124919856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124919856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124919858 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124919858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124919858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124919858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:20.813751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23852): Terminating (SIGTERM) 12:49:20.854746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23855): Terminating (SIGTERM) 12:49:20.896060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23858): Terminating (SIGTERM) 12:49:20.937537 --- ParallelTerminationStrategy: PID 23852 died... 12:49:20.957594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23852): Terminated: ok {rc=0} 12:49:21.003385 --- ParallelTerminationStrategy: PID 23855 died... 12:49:21.022894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23855): Terminated: ok {rc=0} 12:49:21.068460 --- ParallelTerminationStrategy: PID 23858 died... 12:49:21.087934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23858): Terminated: ok {rc=0} 12:49:21.174813 bus /sierra_3: Setting Powered False 12:49:22.272867 bus /sierra_3: Setting Powered False 12:49:23.387251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 12:49:24.648900 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:24.654792 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:49:24.719477 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:49:24.746662 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:49:24.799633 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:49:24.865388 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:49:24.891530 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:49:25.442874 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 12:49:25.448373 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:25.459752 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:49:25.512130 tst handover.py: using LAC 41030 12:49:25.629999 tst handover.py: using RAC 230 12:49:25.746159 tst handover.py: using CellId 41030 12:49:25.863938 tst handover.py: using BVCI 41031 12:49:25.971931 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:49:26.020270 tst handover.py: using LAC 41031 12:49:26.137620 tst handover.py: using RAC 231 12:49:26.262896 tst handover.py: using CellId 41031 12:49:26.388026 tst handover.py: using BVCI 41032 12:49:26.504452 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:26.516004 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:26.527149 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:26.538511 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:26.549653 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:26.560855 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:49:26.675461 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:49:26.795570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:27.266278 run create_hlr_db(pid=23865): Launched 12:49:27.395992 bus /sierra_2: Setting Powered False 12:49:28.459843 run create_hlr_db(pid=23865): Terminated: ok {rc=0} 12:49:28.863889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23867): Launched 12:49:29.163887 run osmo-hlr_10.42.42.2(pid=23868): Launched 12:49:29.277848 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:29.781899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23870): Launched 12:49:30.080697 run osmo-stp_10.42.42.5(pid=23871): Launched 12:49:30.195279 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:30.711342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23873): Launched 12:49:31.037351 run osmo-msc_10.42.42.6(pid=23874): Launched 12:49:31.379529 run osmo-stp_10.42.42.5(pid=23871): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23871)] 12:49:31.635773 run osmo-stp_10.42.42.5(pid=23871): stdout: | (launched: 2022-12-14_12:49:30.025512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:31.909796 run osmo-stp_10.42.42.5(pid=23871): stderr: | [0;m[38;5;43m20221214124930196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124930196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124930196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124930196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124930199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124930199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124930199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:32.088822 run osmo-stp_10.42.42.5(pid=23871): stdout: | (launched: 2022-12-14_12:49:30.025512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:32.211347 run osmo-stp_10.42.42.5(pid=23871): stderr: | [0;m[38;5;43m20221214124930196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124930196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124930196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124930196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124930199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124930199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124930199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:32.354494 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23871): Process ended prematurely: osmo-stp_10.42.42.5(pid=23871) [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23871)] [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 12:49:32.362732 tst handover.py:18: Test FAILED (6.9 sec) 12:49:32.388502 run osmo-hlr_10.42.42.2(pid=23868): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23868)] 12:49:32.437306 run osmo-hlr_10.42.42.2(pid=23868): stdout: | (launched: 2022-12-14_12:49:29.109152) 12:49:32.486556 run osmo-hlr_10.42.42.2(pid=23868): stderr: | [0;m[1;31m20221214124929285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124929285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124929285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124929285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124929285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124929285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124929297 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124929305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124929306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124929306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:32.555213 run osmo-msc_10.42.42.6(pid=23874): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23874)] 12:49:32.602526 run osmo-msc_10.42.42.6(pid=23874): stdout: | (launched: 2022-12-14_12:49:30.977275) 12:49:32.651636 run osmo-msc_10.42.42.6(pid=23874): stderr: | [0;m[38;5;43m20221214124931564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124931564 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f915a0dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124931564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124931564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124931564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124931564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124931574 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124931574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124931575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124931575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:32.701478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23867): Terminating (SIGTERM) 12:49:32.741367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23870): Terminating (SIGTERM) 12:49:32.781156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23873): Terminating (SIGTERM) 12:49:32.821181 --- ParallelTerminationStrategy: PID 23867 died... 12:49:32.840552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23867): Terminated: ok {rc=0} 12:49:32.884411 --- ParallelTerminationStrategy: PID 23870 died... 12:49:32.903191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23870): Terminated: ok {rc=0} 12:49:32.947076 --- ParallelTerminationStrategy: PID 23873 died... 12:49:32.965840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23873): Terminated: ok {rc=0} 12:49:33.049443 bus /sierra_3: Setting Powered False 12:49:34.146600 bus /sierra_3: Setting Powered False 12:49:35.264104 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 12:49:36.537967 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:36.543129 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:49:36.605241 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:49:36.631193 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:49:36.680496 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:49:36.742639 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:49:36.768606 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:49:37.321499 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 12:49:37.326730 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:37.337850 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:49:37.386165 tst handover.py: using LAC 41032 12:49:37.507060 tst handover.py: using RAC 232 12:49:37.624872 tst handover.py: using CellId 41032 12:49:37.741357 tst handover.py: using BVCI 41033 12:49:37.850012 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:49:37.895643 tst handover.py: using LAC 41033 12:49:38.013285 tst handover.py: using RAC 233 12:49:38.128734 tst handover.py: using CellId 41033 12:49:38.245317 tst handover.py: using BVCI 41034 12:49:38.355504 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:38.366644 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:38.377679 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:38.388589 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:38.400001 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:49:38.411351 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:49:38.527384 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:49:38.647430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:39.118218 run create_hlr_db(pid=23880): Launched 12:49:39.248317 bus /sierra_2: Setting Powered False 12:49:40.312554 run create_hlr_db(pid=23880): Terminated: ok {rc=0} 12:49:40.731512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23882): Launched 12:49:41.052340 run osmo-hlr_10.42.42.2(pid=23883): Launched 12:49:41.174441 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:41.696725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23885): Launched 12:49:42.017481 run osmo-stp_10.42.42.5(pid=23886): Launched 12:49:42.139365 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:42.692426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23888): Launched 12:49:43.013152 run osmo-msc_10.42.42.6(pid=23889): Launched 12:49:43.192026 run osmo-stp_10.42.42.5(pid=23886): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23886)] 12:49:43.327590 run osmo-stp_10.42.42.5(pid=23886): stdout: | (launched: 2022-12-14_12:49:41.958626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:43.463159 run osmo-stp_10.42.42.5(pid=23886): stderr: | [0;m[38;5;43m20221214124942150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124942150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124942150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124942150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124942153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124942153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124942153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:43.597719 run osmo-stp_10.42.42.5(pid=23886): stdout: | (launched: 2022-12-14_12:49:41.958626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:43.725514 run osmo-stp_10.42.42.5(pid=23886): stderr: | [0;m[38;5;43m20221214124942150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124942150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124942150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124942150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124942153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124942153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124942153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:43.878233 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23886): Process ended prematurely: osmo-stp_10.42.42.5(pid=23886) [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23886)] [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 12:49:43.887048 tst handover.py:18: Test FAILED (6.6 sec) 12:49:43.914047 run osmo-hlr_10.42.42.2(pid=23883): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23883)] 12:49:43.963394 run osmo-hlr_10.42.42.2(pid=23883): stdout: | (launched: 2022-12-14_12:49:40.993617) 12:49:44.014221 run osmo-hlr_10.42.42.2(pid=23883): stderr: | [0;m[1;31m20221214124941191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124941191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124941191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124941191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124941191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124941191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124941214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124941224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124941224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124941224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:44.085181 run osmo-msc_10.42.42.6(pid=23889): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23889)] 12:49:44.134189 run osmo-msc_10.42.42.6(pid=23889): stdout: | (launched: 2022-12-14_12:49:42.954320) 12:49:44.184921 run osmo-msc_10.42.42.6(pid=23889): stderr: | [0;m[38;5;43m20221214124943278 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124943278 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa9648ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124943278 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124943278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124943278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124943279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124943280 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124943281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124943281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124943281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:44.236598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23882): Terminating (SIGTERM) 12:49:44.277641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23885): Terminating (SIGTERM) 12:49:44.318711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23888): Terminating (SIGTERM) 12:49:44.359939 --- ParallelTerminationStrategy: PID 23882 died... 12:49:44.379741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23882): Terminated: ok {rc=0} 12:49:44.425311 --- ParallelTerminationStrategy: PID 23885 died... 12:49:44.444618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23885): Terminated: ok {rc=0} 12:49:44.490217 --- ParallelTerminationStrategy: PID 23888 died... 12:49:44.509654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23888): Terminated: ok {rc=0} 12:49:44.595293 bus /sierra_3: Setting Powered False 12:49:45.692185 bus /sierra_3: Setting Powered False 12:49:46.815396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 12:49:48.092264 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:48.098598 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:49:48.149585 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:49:48.176343 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:49:48.228614 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:49:48.279112 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:49:48.305154 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:49:48.860308 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 12:49:48.865875 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:48.877448 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:49:48.920779 tst handover.py: using LAC 41034 12:49:49.038422 tst handover.py: using RAC 234 12:49:49.155618 tst handover.py: using CellId 41034 12:49:49.271617 tst handover.py: using BVCI 41035 12:49:49.380058 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:49:49.426381 tst handover.py: using LAC 41035 12:49:49.544107 tst handover.py: using RAC 235 12:49:49.660313 tst handover.py: using CellId 41035 12:49:49.776212 tst handover.py: using BVCI 41036 12:49:49.895536 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:49.907003 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:49.918219 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:49.929544 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:49.941292 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:49:49.952846 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:49:50.071326 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:49:50.189299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:50.661171 run create_hlr_db(pid=23896): Launched 12:49:50.791208 bus /sierra_2: Setting Powered False 12:49:51.855009 run create_hlr_db(pid=23896): Terminated: ok {rc=0} 12:49:52.274963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23898): Launched 12:49:52.595358 run osmo-hlr_10.42.42.2(pid=23899): Launched 12:49:52.719775 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:53.243626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23901): Launched 12:49:53.564538 run osmo-stp_10.42.42.5(pid=23902): Launched 12:49:53.688503 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:54.240526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23904): Launched 12:49:54.560450 run osmo-msc_10.42.42.6(pid=23905): Launched 12:49:54.738716 run osmo-stp_10.42.42.5(pid=23902): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23902)] 12:49:54.873276 run osmo-stp_10.42.42.5(pid=23902): stdout: | (launched: 2022-12-14_12:49:53.505702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:55.008671 run osmo-stp_10.42.42.5(pid=23902): stderr: | [0;m[38;5;43m20221214124953699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124953700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124953700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124953700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124953701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124953701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124953701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:55.143712 run osmo-stp_10.42.42.5(pid=23902): stdout: | (launched: 2022-12-14_12:49:53.505702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:55.272317 run osmo-stp_10.42.42.5(pid=23902): stderr: | [0;m[38;5;43m20221214124953699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214124953700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214124953700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214124953700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214124953701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214124953701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214124953701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:55.424776 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23902): Process ended prematurely: osmo-stp_10.42.42.5(pid=23902) [trial-2404↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23902)] [trial-2404↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 12:49:55.433918 tst handover.py:18: Test FAILED (6.6 sec) 12:49:55.461151 run osmo-hlr_10.42.42.2(pid=23899): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23899)] 12:49:55.510732 run osmo-hlr_10.42.42.2(pid=23899): stdout: | (launched: 2022-12-14_12:49:52.536749) 12:49:55.561774 run osmo-hlr_10.42.42.2(pid=23899): stderr: | [0;m[1;31m20221214124952735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214124952735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214124952735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214124952735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214124952735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214124952735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214124952748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214124952756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214124952756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214124952756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:55.633063 run osmo-msc_10.42.42.6(pid=23905): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23905)] 12:49:55.682214 run osmo-msc_10.42.42.6(pid=23905): stdout: | (launched: 2022-12-14_12:49:54.502012) 12:49:55.732924 run osmo-msc_10.42.42.6(pid=23905): stderr: | [0;m[38;5;43m20221214124954825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214124954825 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f27227dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214124954825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214124954825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214124954825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214124954825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214124954827 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214124954827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214124954828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214124954828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:55.784128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23898): Terminating (SIGTERM) 12:49:55.825302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23901): Terminating (SIGTERM) 12:49:55.866467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23904): Terminating (SIGTERM) 12:49:55.908276 --- ParallelTerminationStrategy: PID 23898 died... 12:49:55.928141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23898): Terminated: ok {rc=0} 12:49:55.974123 --- ParallelTerminationStrategy: PID 23901 died... 12:49:55.993666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23901): Terminated: ok {rc=0} 12:49:56.039498 --- ParallelTerminationStrategy: PID 23904 died... 12:49:56.059096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23904): Terminated: ok {rc=0} 12:49:56.146034 bus /sierra_3: Setting Powered False 12:49:57.243959 bus /sierra_3: Setting Powered False 12:49:58.361901 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 12:49:59.618928 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:59.624311 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:49:59.674355 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:49:59.700392 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:49:59.751176 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:49:59.800548 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:49:59.826838 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:50:00.381271 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 12:50:00.387516 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:00.399424 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:50:00.432716 tst handover.py: using LAC 41036 12:50:00.558551 tst handover.py: using RAC 236 12:50:00.683082 tst handover.py: using CellId 41036 12:50:00.806675 tst handover.py: using BVCI 41037 12:50:00.937847 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:50:00.988370 tst handover.py: using LAC 41037 12:50:01.114261 tst handover.py: using RAC 237 12:50:01.235320 tst handover.py: using CellId 41037 12:50:01.357062 tst handover.py: using BVCI 41038 12:50:01.472419 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:01.484357 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:01.496035 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:01.507615 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:01.520473 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:01.533899 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:50:01.657935 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:50:01.799084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:02.374654 run create_hlr_db(pid=23913): Launched 12:50:02.490900 bus /sierra_2: Setting Powered False 12:50:03.550677 run create_hlr_db(pid=23913): Terminated: ok {rc=0} 12:50:03.945201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23915): Launched 12:50:04.244233 run osmo-hlr_10.42.42.2(pid=23916): Launched 12:50:04.358455 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:04.861180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23918): Launched 12:50:05.159902 run osmo-stp_10.42.42.5(pid=23919): Launched 12:50:05.273884 run osmo-msc_10.42.42.6: Starting osmo-msc 12:50:05.789947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23921): Launched 12:50:06.088462 run osmo-msc_10.42.42.6(pid=23922): Launched 12:50:06.255776 run osmo-stp_10.42.42.5(pid=23919): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23919)] 12:50:06.383778 run osmo-stp_10.42.42.5(pid=23919): stdout: | (launched: 2022-12-14_12:50:05.104590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:06.510823 run osmo-stp_10.42.42.5(pid=23919): stderr: | [0;m[38;5;43m20221214125005275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214125005276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214125005276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214125005276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125005277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125005277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125005277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:06.635820 run osmo-stp_10.42.42.5(pid=23919): stdout: | (launched: 2022-12-14_12:50:05.104590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:06.754866 run osmo-stp_10.42.42.5(pid=23919): stderr: | [0;m[38;5;43m20221214125005275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214125005276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214125005276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214125005276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125005277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125005277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125005277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:06.897501 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23919): Process ended prematurely: osmo-stp_10.42.42.5(pid=23919) [trial-2404↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23919)] [trial-2404↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 12:50:06.905976 tst handover.py:18: Test FAILED (6.5 sec) 12:50:06.932049 run osmo-hlr_10.42.42.2(pid=23916): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23916)] 12:50:06.980595 run osmo-hlr_10.42.42.2(pid=23916): stdout: | (launched: 2022-12-14_12:50:04.188799) 12:50:07.030275 run osmo-hlr_10.42.42.2(pid=23916): stderr: | [0;m[1;31m20221214125004365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214125004365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214125004365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214125004365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214125004365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214125004365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214125004377 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214125004385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125004385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125004385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:07.099690 run osmo-msc_10.42.42.6(pid=23922): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23922)] 12:50:07.147497 run osmo-msc_10.42.42.6(pid=23922): stdout: | (launched: 2022-12-14_12:50:06.033103) 12:50:07.196837 run osmo-msc_10.42.42.6(pid=23922): stderr: | [0;m[38;5;43m20221214125006302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214125006302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe6621ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214125006302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214125006302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214125006302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214125006303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214125006304 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214125006305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125006305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125006305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:50:07.246626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23915): Terminating (SIGTERM) 12:50:07.286642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23918): Terminating (SIGTERM) 12:50:07.326703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23921): Terminating (SIGTERM) 12:50:07.367410 --- ParallelTerminationStrategy: PID 23915 died... 12:50:07.387219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23915): Terminated: ok {rc=0} 12:50:07.431625 --- ParallelTerminationStrategy: PID 23918 died... 12:50:07.450689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23918): Terminated: ok {rc=0} 12:50:07.494817 --- ParallelTerminationStrategy: PID 23921 died... 12:50:07.513864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23921): Terminated: ok {rc=0} 12:50:07.600106 bus /sierra_3: Setting Powered False 12:50:08.700540 bus /sierra_3: Setting Powered False 12:50:09.818461 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2404 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 12:50:11.073067 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:50:11.078579 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:50:11.140712 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:50:11.166971 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:50:11.218981 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:50:11.283255 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:50:11.310380 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:50:11.855198 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2404 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 12:50:11.861451 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:11.872659 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:50:11.921558 tst handover.py: using LAC 41038 12:50:12.050860 tst handover.py: using RAC 238 12:50:12.178417 tst handover.py: using CellId 41038 12:50:12.305981 tst handover.py: using BVCI 41039 12:50:12.422831 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:50:12.472725 tst handover.py: using LAC 41039 12:50:12.600370 tst handover.py: using RAC 239 12:50:12.727105 tst handover.py: using CellId 41039 12:50:12.854962 tst handover.py: using BVCI 41040 12:50:12.971700 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:12.983136 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:12.994498 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:13.005801 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:13.016797 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:50:13.027837 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:50:13.142941 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:50:13.263869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:13.734286 run create_hlr_db(pid=23927): Launched 12:50:13.864090 bus /sierra_2: Setting Powered False 12:50:14.928743 run create_hlr_db(pid=23927): Terminated: ok {rc=0} 12:50:15.332936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23929): Launched 12:50:15.632795 run osmo-hlr_10.42.42.2(pid=23930): Launched 12:50:15.747309 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:16.381105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23932): Launched 12:50:16.737706 run osmo-stp_10.42.42.5(pid=23933): Launched 12:50:16.977145 run osmo-msc_10.42.42.6: Starting osmo-msc 12:50:17.610102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23935): Launched 12:50:17.932231 run osmo-msc_10.42.42.6(pid=23936): Launched 12:50:18.110486 run osmo-stp_10.42.42.5(pid=23933): ERR: Terminated: ERROR {rc=1} [trial-2404↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23933)] 12:50:18.245144 run osmo-stp_10.42.42.5(pid=23933): stdout: | (launched: 2022-12-14_12:50:16.664380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:18.380530 run osmo-stp_10.42.42.5(pid=23933): stderr: | [0;m[38;5;43m20221214125016969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214125016969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214125016970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214125016970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125016970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125016971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125016971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:18.515913 run osmo-stp_10.42.42.5(pid=23933): stdout: | (launched: 2022-12-14_12:50:16.664380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:18.644123 run osmo-stp_10.42.42.5(pid=23933): stderr: | [0;m[38;5;43m20221214125016969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214125016969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214125016970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214125016970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125016970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125016971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125016971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:18.796870 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=23933): Process ended prematurely: osmo-stp_10.42.42.5(pid=23933) [trial-2404↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23933)] [trial-2404↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 12:50:18.805895 tst handover.py:18: Test FAILED (6.9 sec) 12:50:18.833422 run osmo-hlr_10.42.42.2(pid=23930): ERR: Terminated: ERROR {rc=237} [trial-2404↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23930)] 12:50:18.883969 run osmo-hlr_10.42.42.2(pid=23930): stdout: | (launched: 2022-12-14_12:50:15.577296) 12:50:18.936146 run osmo-hlr_10.42.42.2(pid=23930): stderr: | [0;m[1;31m20221214125015756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214125015756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214125015756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214125015756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214125015756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214125015757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214125015767 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214125015776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125015776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125015776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:19.008630 run osmo-msc_10.42.42.6(pid=23936): ERR: Terminated: ERROR {rc=2} [trial-2404↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23936)] 12:50:19.057968 run osmo-msc_10.42.42.6(pid=23936): stdout: | (launched: 2022-12-14_12:50:17.872895) 12:50:19.109059 run osmo-msc_10.42.42.6(pid=23936): stderr: | [0;m[38;5;43m20221214125018195 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214125018195 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f735b519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214125018195 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214125018195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214125018195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214125018196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214125018197 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214125018198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125018198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125018198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:50:19.160310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23929): Terminating (SIGTERM) 12:50:19.201668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23932): Terminating (SIGTERM) 12:50:19.243152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23935): Terminating (SIGTERM) 12:50:19.284654 --- ParallelTerminationStrategy: PID 23929 died... 12:50:19.304826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23929): Terminated: ok {rc=0} 12:50:19.351115 --- ParallelTerminationStrategy: PID 23932 died... 12:50:19.370802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23932): Terminated: ok {rc=0} 12:50:19.416756 --- ParallelTerminationStrategy: PID 23935 died... 12:50:19.436419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23935): Terminated: ok {rc=0} 12:50:19.523448 bus /sierra_3: Setting Powered False 12:50:20.620089 bus /sierra_3: Setting Powered False 12:50:21.735419 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2404 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 12:50:23.003683 tst trial-2404: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404/run.2022-12-14_11-25-45/trial-2404.xml -------------------------------------------------------------------------------------------- trial-2404 FAIL -------------------------------------------------------------------------------------------- 12:50:24.928698 tst trial-2404: trial-2404: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.8 sec) Error: osmo-nitb_10.42.42.2(pid=16273): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16273) [trial-2404↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16273)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.3 sec) Error: osmo-stp_10.42.42.5(pid=16285): Process ended prematurely: osmo-stp_10.42.42.5(pid=16285) [trial-2404↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16285)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=16294): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16294) [trial-2404↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16294)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16307): Process ended prematurely: osmo-stp_10.42.42.5(pid=16307) [trial-2404↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16307)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16321): Process ended prematurely: osmo-stp_10.42.42.5(pid=16321) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16321)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16332): Process ended prematurely: osmo-stp_10.42.42.5(pid=16332) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16332)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16346): Process ended prematurely: osmo-stp_10.42.42.5(pid=16346) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16346)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16357): Process ended prematurely: osmo-stp_10.42.42.5(pid=16357) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16357)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16371): Process ended prematurely: osmo-stp_10.42.42.5(pid=16371) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16371)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16382): Process ended prematurely: osmo-stp_10.42.42.5(pid=16382) [trial-2404↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16382)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16398): Process ended prematurely: osmo-stp_10.42.42.5(pid=16398) [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16398)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16409): Process ended prematurely: osmo-stp_10.42.42.5(pid=16409) [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16409)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16426): Process ended prematurely: osmo-stp_10.42.42.5(pid=16426) [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16426)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16437): Process ended prematurely: osmo-stp_10.42.42.5(pid=16437) [trial-2404↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16437)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16451): Process ended prematurely: osmo-stp_10.42.42.5(pid=16451) [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16451)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16462): Process ended prematurely: osmo-stp_10.42.42.5(pid=16462) [trial-2404↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16462)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16480): Process ended prematurely: osmo-stp_10.42.42.5(pid=16480) [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16480)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16491): Process ended prematurely: osmo-stp_10.42.42.5(pid=16491) [trial-2404↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16491)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16505): Process ended prematurely: osmo-stp_10.42.42.5(pid=16505) [trial-2404↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16505)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16517): Process ended prematurely: osmo-stp_10.42.42.5(pid=16517) [trial-2404↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16517)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.5 sec) Error: osmo-stp_10.42.42.5(pid=16535): Process ended prematurely: osmo-stp_10.42.42.5(pid=16535) [trial-2404↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16535)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16547): Process ended prematurely: osmo-stp_10.42.42.5(pid=16547) [trial-2404↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16547)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=16565): Process ended prematurely: osmo-stp_10.42.42.5(pid=16565) [trial-2404↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16565)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16575): Process ended prematurely: osmo-stp_10.42.42.5(pid=16575) [trial-2404↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16575)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16585): Process ended prematurely: osmo-stp_10.42.42.5(pid=16585) [trial-2404↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16585)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=16602): Process ended prematurely: osmo-stp_10.42.42.5(pid=16602) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16602)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16614): Process ended prematurely: osmo-stp_10.42.42.5(pid=16614) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16614)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=16633): Process ended prematurely: osmo-stp_10.42.42.5(pid=16633) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16633)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16643): Process ended prematurely: osmo-stp_10.42.42.5(pid=16643) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16643)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=16653): Process ended prematurely: osmo-stp_10.42.42.5(pid=16653) [trial-2404↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16653)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=16672): Process ended prematurely: osmo-stp_10.42.42.5(pid=16672) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16672)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=16684): Process ended prematurely: osmo-stp_10.42.42.5(pid=16684) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16684)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=16702): Process ended prematurely: osmo-stp_10.42.42.5(pid=16702) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16702)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16712): Process ended prematurely: osmo-stp_10.42.42.5(pid=16712) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16712)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=16722): Process ended prematurely: osmo-stp_10.42.42.5(pid=16722) [trial-2404↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16722)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=16742): Process ended prematurely: osmo-stp_10.42.42.5(pid=16742) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16742)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16754): Process ended prematurely: osmo-stp_10.42.42.5(pid=16754) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16754)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=16775): Process ended prematurely: osmo-stp_10.42.42.5(pid=16775) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16775)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16785): Process ended prematurely: osmo-stp_10.42.42.5(pid=16785) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16785)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16795): Process ended prematurely: osmo-stp_10.42.42.5(pid=16795) [trial-2404↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16795)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16808): Process ended prematurely: osmo-stp_10.42.42.5(pid=16808) [trial-2404↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16808)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16823): Process ended prematurely: osmo-stp_10.42.42.5(pid=16823) [trial-2404↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16823)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=16831): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16831) [trial-2404↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16831)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=16841): Process ended prematurely: osmo-stp_10.42.42.5(pid=16841) [trial-2404↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16841)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=16850): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16850) [trial-2404↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16850)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=16860): Process ended prematurely: osmo-stp_10.42.42.5(pid=16860) [trial-2404↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16860)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16875): Process ended prematurely: osmo-stp_10.42.42.5(pid=16875) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16875)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16886): Process ended prematurely: osmo-stp_10.42.42.5(pid=16886) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16886)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16900): Process ended prematurely: osmo-stp_10.42.42.5(pid=16900) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16900)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16911): Process ended prematurely: osmo-stp_10.42.42.5(pid=16911) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16911)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16925): Process ended prematurely: osmo-stp_10.42.42.5(pid=16925) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16925)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16936): Process ended prematurely: osmo-stp_10.42.42.5(pid=16936) [trial-2404↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16936)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16950): Process ended prematurely: osmo-stp_10.42.42.5(pid=16950) [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16950)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16961): Process ended prematurely: osmo-stp_10.42.42.5(pid=16961) [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16961)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16978): Process ended prematurely: osmo-stp_10.42.42.5(pid=16978) [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16978)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16989): Process ended prematurely: osmo-stp_10.42.42.5(pid=16989) [trial-2404↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16989)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17004): Process ended prematurely: osmo-stp_10.42.42.5(pid=17004) [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17004)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17015): Process ended prematurely: osmo-stp_10.42.42.5(pid=17015) [trial-2404↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17015)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17029): Process ended prematurely: osmo-stp_10.42.42.5(pid=17029) [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17029)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17040): Process ended prematurely: osmo-stp_10.42.42.5(pid=17040) [trial-2404↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17040)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=17325): Process ended prematurely: osmo-stp_10.42.42.5(pid=17325) [trial-2404↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17325)] FAIL: emergency_preemptive_call.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=17336): Process ended prematurely: osmo-stp_10.42.42.5(pid=17336) [trial-2404↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17336)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=17356): Process ended prematurely: osmo-stp_10.42.42.5(pid=17356) [trial-2404↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17356)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17368): Process ended prematurely: osmo-stp_10.42.42.5(pid=17368) [trial-2404↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17368)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=17389): Process ended prematurely: osmo-stp_10.42.42.5(pid=17389) [trial-2404↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17389)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17399): Process ended prematurely: osmo-stp_10.42.42.5(pid=17399) [trial-2404↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17399)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17409): Process ended prematurely: osmo-stp_10.42.42.5(pid=17409) [trial-2404↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17409)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=17426): Process ended prematurely: osmo-stp_10.42.42.5(pid=17426) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17426)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17442): Process ended prematurely: osmo-stp_10.42.42.5(pid=17442) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17442)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=17460): Process ended prematurely: osmo-stp_10.42.42.5(pid=17460) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17460)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17470): Process ended prematurely: osmo-stp_10.42.42.5(pid=17470) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17470)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17480): Process ended prematurely: osmo-stp_10.42.42.5(pid=17480) [trial-2404↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17480)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=17497): Process ended prematurely: osmo-stp_10.42.42.5(pid=17497) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17497)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17510): Process ended prematurely: osmo-stp_10.42.42.5(pid=17510) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17510)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=17532): Process ended prematurely: osmo-stp_10.42.42.5(pid=17532) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17532)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17542): Process ended prematurely: osmo-stp_10.42.42.5(pid=17542) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17542)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17552): Process ended prematurely: osmo-stp_10.42.42.5(pid=17552) [trial-2404↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17552)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=17569): Process ended prematurely: osmo-stp_10.42.42.5(pid=17569) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17569)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17581): Process ended prematurely: osmo-stp_10.42.42.5(pid=17581) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17581)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=17599): Process ended prematurely: osmo-stp_10.42.42.5(pid=17599) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17599)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17609): Process ended prematurely: osmo-stp_10.42.42.5(pid=17609) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17609)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17619): Process ended prematurely: osmo-stp_10.42.42.5(pid=17619) [trial-2404↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17619)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17632): Process ended prematurely: osmo-stp_10.42.42.5(pid=17632) [trial-2404↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17632)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17645): Process ended prematurely: osmo-stp_10.42.42.5(pid=17645) [trial-2404↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17645)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=17655): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17655) [trial-2404↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17655)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17666): Process ended prematurely: osmo-stp_10.42.42.5(pid=17666) [trial-2404↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17666)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=17675): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17675) [trial-2404↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17675)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=17686): Process ended prematurely: osmo-stp_10.42.42.5(pid=17686) [trial-2404↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17686)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17700): Process ended prematurely: osmo-stp_10.42.42.5(pid=17700) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17700)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17711): Process ended prematurely: osmo-stp_10.42.42.5(pid=17711) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17711)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17725): Process ended prematurely: osmo-stp_10.42.42.5(pid=17725) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17725)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17739): Process ended prematurely: osmo-stp_10.42.42.5(pid=17739) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17739)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17753): Process ended prematurely: osmo-stp_10.42.42.5(pid=17753) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17753)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17764): Process ended prematurely: osmo-stp_10.42.42.5(pid=17764) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17764)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17779): Process ended prematurely: osmo-stp_10.42.42.5(pid=17779) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17779)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17790): Process ended prematurely: osmo-stp_10.42.42.5(pid=17790) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17790)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17805): Process ended prematurely: osmo-stp_10.42.42.5(pid=17805) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17805)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17816): Process ended prematurely: osmo-stp_10.42.42.5(pid=17816) [trial-2404↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17816)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17830): Process ended prematurely: osmo-stp_10.42.42.5(pid=17830) [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17830)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17841): Process ended prematurely: osmo-stp_10.42.42.5(pid=17841) [trial-2404↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17841)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17855): Process ended prematurely: osmo-stp_10.42.42.5(pid=17855) [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17855)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17867): Process ended prematurely: osmo-stp_10.42.42.5(pid=17867) [trial-2404↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17867)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17881): Process ended prematurely: osmo-stp_10.42.42.5(pid=17881) [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17881)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17892): Process ended prematurely: osmo-stp_10.42.42.5(pid=17892) [trial-2404↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17892)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17907): Process ended prematurely: osmo-stp_10.42.42.5(pid=17907) [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17907)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17918): Process ended prematurely: osmo-stp_10.42.42.5(pid=17918) [trial-2404↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17918)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17932): Process ended prematurely: osmo-stp_10.42.42.5(pid=17932) [trial-2404↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17932)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17943): Process ended prematurely: osmo-stp_10.42.42.5(pid=17943) [trial-2404↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17943)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=17961): Process ended prematurely: osmo-stp_10.42.42.5(pid=17961) [trial-2404↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17961)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17973): Process ended prematurely: osmo-stp_10.42.42.5(pid=17973) [trial-2404↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17973)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=17991): Process ended prematurely: osmo-stp_10.42.42.5(pid=17991) [trial-2404↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17991)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18001): Process ended prematurely: osmo-stp_10.42.42.5(pid=18001) [trial-2404↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18001)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18011): Process ended prematurely: osmo-stp_10.42.42.5(pid=18011) [trial-2404↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18011)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18029): Process ended prematurely: osmo-stp_10.42.42.5(pid=18029) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18029)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=18041): Process ended prematurely: osmo-stp_10.42.42.5(pid=18041) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18041)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=18059): Process ended prematurely: osmo-stp_10.42.42.5(pid=18059) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18059)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18069): Process ended prematurely: osmo-stp_10.42.42.5(pid=18069) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18069)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18085): Process ended prematurely: osmo-stp_10.42.42.5(pid=18085) [trial-2404↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18085)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18102): Process ended prematurely: osmo-stp_10.42.42.5(pid=18102) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18102)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18114): Process ended prematurely: osmo-stp_10.42.42.5(pid=18114) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18114)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=18132): Process ended prematurely: osmo-stp_10.42.42.5(pid=18132) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18132)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18142): Process ended prematurely: osmo-stp_10.42.42.5(pid=18142) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18142)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18152): Process ended prematurely: osmo-stp_10.42.42.5(pid=18152) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18152)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18171): Process ended prematurely: osmo-stp_10.42.42.5(pid=18171) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18171)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=18183): Process ended prematurely: osmo-stp_10.42.42.5(pid=18183) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18183)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=18201): Process ended prematurely: osmo-stp_10.42.42.5(pid=18201) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18201)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=18211): Process ended prematurely: osmo-stp_10.42.42.5(pid=18211) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18211)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18222): Process ended prematurely: osmo-stp_10.42.42.5(pid=18222) [trial-2404↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18222)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18239): Process ended prematurely: osmo-stp_10.42.42.5(pid=18239) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18239)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18251): Process ended prematurely: osmo-stp_10.42.42.5(pid=18251) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18251)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18269): Process ended prematurely: osmo-stp_10.42.42.5(pid=18269) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18269)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18280): Process ended prematurely: osmo-stp_10.42.42.5(pid=18280) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18280)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18291): Process ended prematurely: osmo-stp_10.42.42.5(pid=18291) [trial-2404↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18291)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18306): Process ended prematurely: osmo-stp_10.42.42.5(pid=18306) [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18306)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18319): Process ended prematurely: osmo-stp_10.42.42.5(pid=18319) [trial-2404↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18319)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=18327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18327) [trial-2404↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18327)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18339): Process ended prematurely: osmo-stp_10.42.42.5(pid=18339) [trial-2404↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18339)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=18348): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18348) [trial-2404↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18348)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=18630): Process ended prematurely: osmo-stp_10.42.42.5(pid=18630) [trial-2404↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18630)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=18644): Process ended prematurely: osmo-stp_10.42.42.5(pid=18644) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18644)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18656): Process ended prematurely: osmo-stp_10.42.42.5(pid=18656) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18656)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18670): Process ended prematurely: osmo-stp_10.42.42.5(pid=18670) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18670)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18681): Process ended prematurely: osmo-stp_10.42.42.5(pid=18681) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18681)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18699): Process ended prematurely: osmo-stp_10.42.42.5(pid=18699) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18699)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18710): Process ended prematurely: osmo-stp_10.42.42.5(pid=18710) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18710)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18724): Process ended prematurely: osmo-stp_10.42.42.5(pid=18724) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18724)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18735): Process ended prematurely: osmo-stp_10.42.42.5(pid=18735) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18735)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18749): Process ended prematurely: osmo-stp_10.42.42.5(pid=18749) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18749)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18760): Process ended prematurely: osmo-stp_10.42.42.5(pid=18760) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18760)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18774): Process ended prematurely: osmo-stp_10.42.42.5(pid=18774) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18774)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18785): Process ended prematurely: osmo-stp_10.42.42.5(pid=18785) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18785)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18799): Process ended prematurely: osmo-stp_10.42.42.5(pid=18799) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18799)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18810): Process ended prematurely: osmo-stp_10.42.42.5(pid=18810) [trial-2404↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18810)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18824): Process ended prematurely: osmo-stp_10.42.42.5(pid=18824) [trial-2404↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18824)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18835): Process ended prematurely: osmo-stp_10.42.42.5(pid=18835) [trial-2404↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18835)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18854): Process ended prematurely: osmo-stp_10.42.42.5(pid=18854) [trial-2404↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18854)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18867): Process ended prematurely: osmo-stp_10.42.42.5(pid=18867) [trial-2404↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18867)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18885): Process ended prematurely: osmo-stp_10.42.42.5(pid=18885) [trial-2404↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18885)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18895): Process ended prematurely: osmo-stp_10.42.42.5(pid=18895) [trial-2404↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18895)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18905): Process ended prematurely: osmo-stp_10.42.42.5(pid=18905) [trial-2404↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18905)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=18922): Process ended prematurely: osmo-stp_10.42.42.5(pid=18922) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18922)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=18934): Process ended prematurely: osmo-stp_10.42.42.5(pid=18934) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18934)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=18952): Process ended prematurely: osmo-stp_10.42.42.5(pid=18952) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18952)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18962): Process ended prematurely: osmo-stp_10.42.42.5(pid=18962) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18962)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18972): Process ended prematurely: osmo-stp_10.42.42.5(pid=18972) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18972)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18990): Process ended prematurely: osmo-stp_10.42.42.5(pid=18990) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18990)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=19002): Process ended prematurely: osmo-stp_10.42.42.5(pid=19002) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19002)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=19020): Process ended prematurely: osmo-stp_10.42.42.5(pid=19020) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19020)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19030): Process ended prematurely: osmo-stp_10.42.42.5(pid=19030) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19030)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19064): Process ended prematurely: osmo-stp_10.42.42.5(pid=19064) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19064)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=19084): Process ended prematurely: osmo-stp_10.42.42.5(pid=19084) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19084)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=19096): Process ended prematurely: osmo-stp_10.42.42.5(pid=19096) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19096)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19115): Process ended prematurely: osmo-stp_10.42.42.5(pid=19115) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19115)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19128): Process ended prematurely: osmo-stp_10.42.42.5(pid=19128) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19128)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19138): Process ended prematurely: osmo-stp_10.42.42.5(pid=19138) [trial-2404↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19138)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19151): Process ended prematurely: osmo-stp_10.42.42.5(pid=19151) [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19151)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19164): Process ended prematurely: osmo-stp_10.42.42.5(pid=19164) [trial-2404↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19164)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=19172): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19172) [trial-2404↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19172)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=19182): Process ended prematurely: osmo-stp_10.42.42.5(pid=19182) [trial-2404↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19182)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=19191): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19191) [trial-2404↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19191)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19201): Process ended prematurely: osmo-stp_10.42.42.5(pid=19201) [trial-2404↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19201)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19215): Process ended prematurely: osmo-stp_10.42.42.5(pid=19215) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19215)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19226): Process ended prematurely: osmo-stp_10.42.42.5(pid=19226) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19226)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19241): Process ended prematurely: osmo-stp_10.42.42.5(pid=19241) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19241)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19252): Process ended prematurely: osmo-stp_10.42.42.5(pid=19252) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19252)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19267): Process ended prematurely: osmo-stp_10.42.42.5(pid=19267) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19267)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19279): Process ended prematurely: osmo-stp_10.42.42.5(pid=19279) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19279)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19293): Process ended prematurely: osmo-stp_10.42.42.5(pid=19293) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19293)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19304): Process ended prematurely: osmo-stp_10.42.42.5(pid=19304) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19304)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19318): Process ended prematurely: osmo-stp_10.42.42.5(pid=19318) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19318)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19329): Process ended prematurely: osmo-stp_10.42.42.5(pid=19329) [trial-2404↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19329)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19343): Process ended prematurely: osmo-stp_10.42.42.5(pid=19343) [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19343)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19354): Process ended prematurely: osmo-stp_10.42.42.5(pid=19354) [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19354)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19368): Process ended prematurely: osmo-stp_10.42.42.5(pid=19368) [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19368)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19379): Process ended prematurely: osmo-stp_10.42.42.5(pid=19379) [trial-2404↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19379)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19394): Process ended prematurely: osmo-stp_10.42.42.5(pid=19394) [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19394)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19405): Process ended prematurely: osmo-stp_10.42.42.5(pid=19405) [trial-2404↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19405)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19422): Process ended prematurely: osmo-stp_10.42.42.5(pid=19422) [trial-2404↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19422)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19433): Process ended prematurely: osmo-stp_10.42.42.5(pid=19433) [trial-2404↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19433)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=19453): Process ended prematurely: osmo-stp_10.42.42.5(pid=19453) [trial-2404↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19453)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=19465): Process ended prematurely: osmo-stp_10.42.42.5(pid=19465) [trial-2404↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19465)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=19483): Process ended prematurely: osmo-stp_10.42.42.5(pid=19483) [trial-2404↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19483)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19493): Process ended prematurely: osmo-stp_10.42.42.5(pid=19493) [trial-2404↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19493)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19503): Process ended prematurely: osmo-stp_10.42.42.5(pid=19503) [trial-2404↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19503)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=19520): Process ended prematurely: osmo-stp_10.42.42.5(pid=19520) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19520)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19532): Process ended prematurely: osmo-stp_10.42.42.5(pid=19532) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19532)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=19550): Process ended prematurely: osmo-stp_10.42.42.5(pid=19550) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19550)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19560): Process ended prematurely: osmo-stp_10.42.42.5(pid=19560) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19560)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19570): Process ended prematurely: osmo-stp_10.42.42.5(pid=19570) [trial-2404↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19570)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19588): Process ended prematurely: osmo-stp_10.42.42.5(pid=19588) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19588)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19601): Process ended prematurely: osmo-stp_10.42.42.5(pid=19601) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19601)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19620): Process ended prematurely: osmo-stp_10.42.42.5(pid=19620) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19620)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19630): Process ended prematurely: osmo-stp_10.42.42.5(pid=19630) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19630)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19640): Process ended prematurely: osmo-stp_10.42.42.5(pid=19640) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19640)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19657): Process ended prematurely: osmo-stp_10.42.42.5(pid=19657) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19657)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19669): Process ended prematurely: osmo-stp_10.42.42.5(pid=19669) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19669)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=19719): Process ended prematurely: osmo-stp_10.42.42.5(pid=19719) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19719)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19976): Process ended prematurely: osmo-stp_10.42.42.5(pid=19976) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19976)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19986): Process ended prematurely: osmo-stp_10.42.42.5(pid=19986) [trial-2404↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19986)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=20003): Process ended prematurely: osmo-stp_10.42.42.5(pid=20003) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20003)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20017): Process ended prematurely: osmo-stp_10.42.42.5(pid=20017) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20017)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=20038): Process ended prematurely: osmo-stp_10.42.42.5(pid=20038) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20038)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20048): Process ended prematurely: osmo-stp_10.42.42.5(pid=20048) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20048)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20058): Process ended prematurely: osmo-stp_10.42.42.5(pid=20058) [trial-2404↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20058)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20071): Process ended prematurely: osmo-stp_10.42.42.5(pid=20071) [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20071)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20084): Process ended prematurely: osmo-stp_10.42.42.5(pid=20084) [trial-2404↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20084)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=20094): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20094) [trial-2404↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20094)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20104): Process ended prematurely: osmo-stp_10.42.42.5(pid=20104) [trial-2404↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20104)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20113): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20113) [trial-2404↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20113)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=20123): Process ended prematurely: osmo-stp_10.42.42.5(pid=20123) [trial-2404↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20123)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20137): Process ended prematurely: osmo-stp_10.42.42.5(pid=20137) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20137)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20149): Process ended prematurely: osmo-stp_10.42.42.5(pid=20149) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20149)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20163): Process ended prematurely: osmo-stp_10.42.42.5(pid=20163) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20163)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20174): Process ended prematurely: osmo-stp_10.42.42.5(pid=20174) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20174)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20190): Process ended prematurely: osmo-stp_10.42.42.5(pid=20190) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20190)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20201): Process ended prematurely: osmo-stp_10.42.42.5(pid=20201) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20201)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20215): Process ended prematurely: osmo-stp_10.42.42.5(pid=20215) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20215)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20226): Process ended prematurely: osmo-stp_10.42.42.5(pid=20226) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20226)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20241): Process ended prematurely: osmo-stp_10.42.42.5(pid=20241) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20241)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20252): Process ended prematurely: osmo-stp_10.42.42.5(pid=20252) [trial-2404↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20252)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20267): Process ended prematurely: osmo-stp_10.42.42.5(pid=20267) [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20278): Process ended prematurely: osmo-stp_10.42.42.5(pid=20278) [trial-2404↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20278)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20292): Process ended prematurely: osmo-stp_10.42.42.5(pid=20292) [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20292)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20303): Process ended prematurely: osmo-stp_10.42.42.5(pid=20303) [trial-2404↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20303)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20317): Process ended prematurely: osmo-stp_10.42.42.5(pid=20317) [trial-2404↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20317)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20328): Process ended prematurely: osmo-stp_10.42.42.5(pid=20328) [trial-2404↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20328)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=20348): Process ended prematurely: osmo-stp_10.42.42.5(pid=20348) [trial-2404↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20348)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20360): Process ended prematurely: osmo-stp_10.42.42.5(pid=20360) [trial-2404↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20360)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=20378): Process ended prematurely: osmo-stp_10.42.42.5(pid=20378) [trial-2404↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20378)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20391): Process ended prematurely: osmo-stp_10.42.42.5(pid=20391) [trial-2404↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20391)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20402): Process ended prematurely: osmo-stp_10.42.42.5(pid=20402) [trial-2404↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20402)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=20420): Process ended prematurely: osmo-stp_10.42.42.5(pid=20420) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20420)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=20432): Process ended prematurely: osmo-stp_10.42.42.5(pid=20432) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20432)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=20454): Process ended prematurely: osmo-stp_10.42.42.5(pid=20454) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20454)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20464): Process ended prematurely: osmo-stp_10.42.42.5(pid=20464) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20464)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=20474): Process ended prematurely: osmo-stp_10.42.42.5(pid=20474) [trial-2404↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20474)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=20491): Process ended prematurely: osmo-stp_10.42.42.5(pid=20491) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20491)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20503): Process ended prematurely: osmo-stp_10.42.42.5(pid=20503) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20503)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=20521): Process ended prematurely: osmo-stp_10.42.42.5(pid=20521) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20521)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20534): Process ended prematurely: osmo-stp_10.42.42.5(pid=20534) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20534)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=20544): Process ended prematurely: osmo-stp_10.42.42.5(pid=20544) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20544)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20575): Process ended prematurely: osmo-stp_10.42.42.5(pid=20575) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20575)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=20593): Process ended prematurely: osmo-stp_10.42.42.5(pid=20593) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20593)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20604): Process ended prematurely: osmo-stp_10.42.42.5(pid=20604) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20604)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20614): Process ended prematurely: osmo-stp_10.42.42.5(pid=20614) [trial-2404↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20614)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=20628): Process ended prematurely: osmo-stp_10.42.42.5(pid=20628) [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20628)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20641): Process ended prematurely: osmo-stp_10.42.42.5(pid=20641) [trial-2404↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20641)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20649): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20649) [trial-2404↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20649)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20659): Process ended prematurely: osmo-stp_10.42.42.5(pid=20659) [trial-2404↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20659)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20668): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20668) [trial-2404↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20668)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20678): Process ended prematurely: osmo-stp_10.42.42.5(pid=20678) [trial-2404↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20678)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20692): Process ended prematurely: osmo-stp_10.42.42.5(pid=20692) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20692)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20703): Process ended prematurely: osmo-stp_10.42.42.5(pid=20703) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20703)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20718): Process ended prematurely: osmo-stp_10.42.42.5(pid=20718) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20718)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20729): Process ended prematurely: osmo-stp_10.42.42.5(pid=20729) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20729)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20753): Process ended prematurely: osmo-stp_10.42.42.5(pid=20753) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20753)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21115): Process ended prematurely: osmo-stp_10.42.42.5(pid=21115) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21115)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21306): Process ended prematurely: osmo-stp_10.42.42.5(pid=21306) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21306)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21317): Process ended prematurely: osmo-stp_10.42.42.5(pid=21317) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21317)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21338): Process ended prematurely: osmo-stp_10.42.42.5(pid=21338) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21338)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21349): Process ended prematurely: osmo-stp_10.42.42.5(pid=21349) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21349)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21363): Process ended prematurely: osmo-stp_10.42.42.5(pid=21363) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21363)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21374): Process ended prematurely: osmo-stp_10.42.42.5(pid=21374) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21374)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21388): Process ended prematurely: osmo-stp_10.42.42.5(pid=21388) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21388)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21399): Process ended prematurely: osmo-stp_10.42.42.5(pid=21399) [trial-2404↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21399)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21413): Process ended prematurely: osmo-stp_10.42.42.5(pid=21413) [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21413)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21424): Process ended prematurely: osmo-stp_10.42.42.5(pid=21424) [trial-2404↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21424)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=21442): Process ended prematurely: osmo-stp_10.42.42.5(pid=21442) [trial-2404↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21442)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21454): Process ended prematurely: osmo-stp_10.42.42.5(pid=21454) [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21454)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21472): Process ended prematurely: osmo-stp_10.42.42.5(pid=21472) [trial-2404↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21472)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21483): Process ended prematurely: osmo-stp_10.42.42.5(pid=21483) [trial-2404↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21483)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21494): Process ended prematurely: osmo-stp_10.42.42.5(pid=21494) [trial-2404↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21494)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=21512): Process ended prematurely: osmo-stp_10.42.42.5(pid=21512) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21512)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21524): Process ended prematurely: osmo-stp_10.42.42.5(pid=21524) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21524)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=21542): Process ended prematurely: osmo-stp_10.42.42.5(pid=21542) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21542)] FAIL: ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=21823): Process ended prematurely: osmo-stp_10.42.42.5(pid=21823) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21823)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21833): Process ended prematurely: osmo-stp_10.42.42.5(pid=21833) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21833)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21851): Process ended prematurely: osmo-stp_10.42.42.5(pid=21851) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21851)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21863): Process ended prematurely: osmo-stp_10.42.42.5(pid=21863) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21863)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=21881): Process ended prematurely: osmo-stp_10.42.42.5(pid=21881) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21894): Process ended prematurely: osmo-stp_10.42.42.5(pid=21894) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21894)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21904): Process ended prematurely: osmo-stp_10.42.42.5(pid=21904) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21904)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=21924): Process ended prematurely: osmo-stp_10.42.42.5(pid=21924) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21924)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=21936): Process ended prematurely: osmo-stp_10.42.42.5(pid=21936) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21936)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21954): Process ended prematurely: osmo-stp_10.42.42.5(pid=21954) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21954)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21964): Process ended prematurely: osmo-stp_10.42.42.5(pid=21964) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21964)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21974): Process ended prematurely: osmo-stp_10.42.42.5(pid=21974) [trial-2404↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21974)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21987): Process ended prematurely: osmo-stp_10.42.42.5(pid=21987) [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21987)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22000): Process ended prematurely: osmo-stp_10.42.42.5(pid=22000) [trial-2404↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22000)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22008): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22008) [trial-2404↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22008)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=22018): Process ended prematurely: osmo-stp_10.42.42.5(pid=22018) [trial-2404↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22018)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=22028): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22028) [trial-2404↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22028)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=22038): Process ended prematurely: osmo-stp_10.42.42.5(pid=22038) [trial-2404↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22038)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22052): Process ended prematurely: osmo-stp_10.42.42.5(pid=22052) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22052)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22063): Process ended prematurely: osmo-stp_10.42.42.5(pid=22063) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22063)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22077): Process ended prematurely: osmo-stp_10.42.42.5(pid=22077) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22077)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22088): Process ended prematurely: osmo-stp_10.42.42.5(pid=22088) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22088)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22102): Process ended prematurely: osmo-stp_10.42.42.5(pid=22102) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22102)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22113): Process ended prematurely: osmo-stp_10.42.42.5(pid=22113) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22113)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22127): Process ended prematurely: osmo-stp_10.42.42.5(pid=22127) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22127)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22139): Process ended prematurely: osmo-stp_10.42.42.5(pid=22139) [trial-2404↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22139)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22153): Process ended prematurely: osmo-stp_10.42.42.5(pid=22153) [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22153)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22164): Process ended prematurely: osmo-stp_10.42.42.5(pid=22164) [trial-2404↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22164)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22178): Process ended prematurely: osmo-stp_10.42.42.5(pid=22178) [trial-2404↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22178)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22189): Process ended prematurely: osmo-stp_10.42.42.5(pid=22189) [trial-2404↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22189)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22207): Process ended prematurely: osmo-stp_10.42.42.5(pid=22207) [trial-2404↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22207)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22219): Process ended prematurely: osmo-stp_10.42.42.5(pid=22219) [trial-2404↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22219)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=22237): Process ended prematurely: osmo-stp_10.42.42.5(pid=22237) [trial-2404↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22237)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22250): Process ended prematurely: osmo-stp_10.42.42.5(pid=22250) [trial-2404↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22250)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22261): Process ended prematurely: osmo-stp_10.42.42.5(pid=22261) [trial-2404↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22261)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22278): Process ended prematurely: osmo-stp_10.42.42.5(pid=22278) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22278)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=22290): Process ended prematurely: osmo-stp_10.42.42.5(pid=22290) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22290)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=22309): Process ended prematurely: osmo-stp_10.42.42.5(pid=22309) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22309)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22319): Process ended prematurely: osmo-stp_10.42.42.5(pid=22319) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22319)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22329): Process ended prematurely: osmo-stp_10.42.42.5(pid=22329) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22329)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22346): Process ended prematurely: osmo-stp_10.42.42.5(pid=22346) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22346)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22358): Process ended prematurely: osmo-stp_10.42.42.5(pid=22358) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22358)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=22376): Process ended prematurely: osmo-stp_10.42.42.5(pid=22376) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22376)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22386): Process ended prematurely: osmo-stp_10.42.42.5(pid=22386) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22386)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22396): Process ended prematurely: osmo-stp_10.42.42.5(pid=22396) [trial-2404↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22396)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22410): Process ended prematurely: osmo-stp_10.42.42.5(pid=22410) [trial-2404↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22410)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=22423): Process ended prematurely: osmo-stp_10.42.42.5(pid=22423) [trial-2404↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22423)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=22432): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22432) [trial-2404↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22432)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22443): Process ended prematurely: osmo-stp_10.42.42.5(pid=22443) [trial-2404↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22443)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22458): Process ended prematurely: osmo-stp_10.42.42.5(pid=22458) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22458)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22469): Process ended prematurely: osmo-stp_10.42.42.5(pid=22469) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22469)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22483): Process ended prematurely: osmo-stp_10.42.42.5(pid=22483) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22483)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22495): Process ended prematurely: osmo-stp_10.42.42.5(pid=22495) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22495)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22509): Process ended prematurely: osmo-stp_10.42.42.5(pid=22509) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22509)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22520): Process ended prematurely: osmo-stp_10.42.42.5(pid=22520) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22520)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22534): Process ended prematurely: osmo-stp_10.42.42.5(pid=22534) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22534)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22545): Process ended prematurely: osmo-stp_10.42.42.5(pid=22545) [trial-2404↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22545)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22559): Process ended prematurely: osmo-stp_10.42.42.5(pid=22559) [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22559)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22570): Process ended prematurely: osmo-stp_10.42.42.5(pid=22570) [trial-2404↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22570)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22584): Process ended prematurely: osmo-stp_10.42.42.5(pid=22584) [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22584)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22598): Process ended prematurely: osmo-stp_10.42.42.5(pid=22598) [trial-2404↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22598)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22612): Process ended prematurely: osmo-stp_10.42.42.5(pid=22612) [trial-2404↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22612)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22623): Process ended prematurely: osmo-stp_10.42.42.5(pid=22623) [trial-2404↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22623)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=22641): Process ended prematurely: osmo-stp_10.42.42.5(pid=22641) [trial-2404↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22641)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22656): Process ended prematurely: osmo-stp_10.42.42.5(pid=22656) [trial-2404↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22656)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=22674): Process ended prematurely: osmo-stp_10.42.42.5(pid=22674) [trial-2404↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22674)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22684): Process ended prematurely: osmo-stp_10.42.42.5(pid=22684) [trial-2404↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22684)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22694): Process ended prematurely: osmo-stp_10.42.42.5(pid=22694) [trial-2404↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22694)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22711): Process ended prematurely: osmo-stp_10.42.42.5(pid=22711) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22711)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22723): Process ended prematurely: osmo-stp_10.42.42.5(pid=22723) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22723)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=22741): Process ended prematurely: osmo-stp_10.42.42.5(pid=22741) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22741)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22751): Process ended prematurely: osmo-stp_10.42.42.5(pid=22751) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22751)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22761): Process ended prematurely: osmo-stp_10.42.42.5(pid=22761) [trial-2404↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22761)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22778): Process ended prematurely: osmo-stp_10.42.42.5(pid=22778) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22778)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22790): Process ended prematurely: osmo-stp_10.42.42.5(pid=22790) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22790)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=22808): Process ended prematurely: osmo-stp_10.42.42.5(pid=22808) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22808)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22818): Process ended prematurely: osmo-stp_10.42.42.5(pid=22818) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22818)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22829): Process ended prematurely: osmo-stp_10.42.42.5(pid=22829) [trial-2404↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22829)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=22847): Process ended prematurely: osmo-stp_10.42.42.5(pid=22847) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22847)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22860): Process ended prematurely: osmo-stp_10.42.42.5(pid=22860) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22860)] FAIL: iperf3m4.py (12.1 sec) Error: osmo-stp_10.42.42.5(pid=23151): Process ended prematurely: osmo-stp_10.42.42.5(pid=23151) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23151)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23161): Process ended prematurely: osmo-stp_10.42.42.5(pid=23161) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23161)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23171): Process ended prematurely: osmo-stp_10.42.42.5(pid=23171) [trial-2404↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23171)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23186): Process ended prematurely: osmo-stp_10.42.42.5(pid=23186) [trial-2404↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23186)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=23194): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23194) [trial-2404↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23194)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=23196): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23196) [trial-2404↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23196)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=23198): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23198) [trial-2404↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23198)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=23200): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23200) [trial-2404↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23200)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.3 sec) Error: osmo-hlr_10.42.42.2(pid=23212): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23212) [trial-2404↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23212)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=23223): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23223) [trial-2404↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23223)] FAIL: esme_ms_sms_storeforward.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23235): Process ended prematurely: osmo-stp_10.42.42.5(pid=23235) [trial-2404↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23235)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23246): Process ended prematurely: osmo-stp_10.42.42.5(pid=23246) [trial-2404↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23246)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23260): Process ended prematurely: osmo-stp_10.42.42.5(pid=23260) [trial-2404↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23260)] FAIL: register_a5_0_authreq.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23271): Process ended prematurely: osmo-stp_10.42.42.5(pid=23271) [trial-2404↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23271)] FAIL: register_a5_1_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23282): Process ended prematurely: osmo-stp_10.42.42.5(pid=23282) [trial-2404↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23282)] FAIL: register_a5_3_authreq.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23293): Process ended prematurely: osmo-stp_10.42.42.5(pid=23293) [trial-2404↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23293)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.7 sec) Error: srsepc(pid=23313): Process ended prematurely: srsepc(pid=23313) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23313)] FAIL: iperf3_bidir.py (18.9 sec) Error: srsepc(pid=23329): Process ended prematurely: srsepc(pid=23329) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23329)] FAIL: iperf3_dl.py (18.6 sec) Error: srsepc(pid=23349): Process ended prematurely: srsepc(pid=23349) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23349)] FAIL: iperf3_ul.py (18.7 sec) Error: srsepc(pid=23366): Process ended prematurely: srsepc(pid=23366) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23366)] FAIL: ping.py (18.5 sec) Error: srsepc(pid=23382): Process ended prematurely: srsepc(pid=23382) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23382)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=23398): Process ended prematurely: srsepc(pid=23398) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23398)] FAIL: rrc_idle_mt_ping.py (18.0 sec) Error: srsepc(pid=23414): Process ended prematurely: srsepc(pid=23414) [trial-2404↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=23414)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23428): Process ended prematurely: osmo-stp_10.42.42.5(pid=23428) [trial-2404↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23428)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23442): Process ended prematurely: osmo-stp_10.42.42.5(pid=23442) [trial-2404↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23442)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23457): Process ended prematurely: osmo-stp_10.42.42.5(pid=23457) [trial-2404↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23457)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23473): Process ended prematurely: osmo-stp_10.42.42.5(pid=23473) [trial-2404↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23473)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23488): Process ended prematurely: osmo-stp_10.42.42.5(pid=23488) [trial-2404↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23488)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23502): Process ended prematurely: osmo-stp_10.42.42.5(pid=23502) [trial-2404↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23502)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23516): Process ended prematurely: osmo-stp_10.42.42.5(pid=23516) [trial-2404↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23516)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23530): Process ended prematurely: osmo-stp_10.42.42.5(pid=23530) [trial-2404↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23530)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23547): Process ended prematurely: osmo-stp_10.42.42.5(pid=23547) [trial-2404↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23547)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23561): Process ended prematurely: osmo-stp_10.42.42.5(pid=23561) [trial-2404↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23561)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23575): Process ended prematurely: osmo-stp_10.42.42.5(pid=23575) [trial-2404↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23575)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23589): Process ended prematurely: osmo-stp_10.42.42.5(pid=23589) [trial-2404↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23589)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23603): Process ended prematurely: osmo-stp_10.42.42.5(pid=23603) [trial-2404↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23603)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23618): Process ended prematurely: osmo-stp_10.42.42.5(pid=23618) [trial-2404↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23618)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23632): Process ended prematurely: osmo-stp_10.42.42.5(pid=23632) [trial-2404↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23632)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23646): Process ended prematurely: osmo-stp_10.42.42.5(pid=23646) [trial-2404↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23646)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23660): Process ended prematurely: osmo-stp_10.42.42.5(pid=23660) [trial-2404↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23660)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23674): Process ended prematurely: osmo-stp_10.42.42.5(pid=23674) [trial-2404↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23674)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23688): Process ended prematurely: osmo-stp_10.42.42.5(pid=23688) [trial-2404↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23688)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23702): Process ended prematurely: osmo-stp_10.42.42.5(pid=23702) [trial-2404↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23702)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23716): Process ended prematurely: osmo-stp_10.42.42.5(pid=23716) [trial-2404↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23716)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23730): Process ended prematurely: osmo-stp_10.42.42.5(pid=23730) [trial-2404↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23730)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=23744): Process ended prematurely: osmo-stp_10.42.42.5(pid=23744) [trial-2404↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23744)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23758): Process ended prematurely: osmo-stp_10.42.42.5(pid=23758) [trial-2404↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23758)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23772): Process ended prematurely: osmo-stp_10.42.42.5(pid=23772) [trial-2404↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23772)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23786): Process ended prematurely: osmo-stp_10.42.42.5(pid=23786) [trial-2404↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23786)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23800): Process ended prematurely: osmo-stp_10.42.42.5(pid=23800) [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23800)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23814): Process ended prematurely: osmo-stp_10.42.42.5(pid=23814) [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23814)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23828): Process ended prematurely: osmo-stp_10.42.42.5(pid=23828) [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23828)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23842): Process ended prematurely: osmo-stp_10.42.42.5(pid=23842) [trial-2404↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23842)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23856): Process ended prematurely: osmo-stp_10.42.42.5(pid=23856) [trial-2404↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23856)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23871): Process ended prematurely: osmo-stp_10.42.42.5(pid=23871) [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23871)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23886): Process ended prematurely: osmo-stp_10.42.42.5(pid=23886) [trial-2404↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23886)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23902): Process ended prematurely: osmo-stp_10.42.42.5(pid=23902) [trial-2404↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23902)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23919): Process ended prematurely: osmo-stp_10.42.42.5(pid=23919) [trial-2404↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23919)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23933): Process ended prematurely: osmo-stp_10.42.42.5(pid=23933) [trial-2404↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23933)] + rm -rf trial-2404/inst + cd trial-2404 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-14 11:25:34 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404-run.tgz run.2022-12-14_11-25-45 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2404-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17689.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6695.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2998.tgz osmo-mgw.build-8965.tgz osmo-msc.build-29318.tgz osmo-nitb.build-12996.tgz osmo-pcu-oc2g.build-3913.tgz osmo-pcu-sysmo.build-5196.tgz osmo-pcu.build-5157.tgz osmo-sgsn.build-30105.tgz osmo-stp.build-9261.tgz osmo-trx.build-4687.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE